-- Logs begin at Wed 2022-06-22 08:03:45 UTC, end at Wed 2022-06-22 09:30:18 UTC. -- Jun 22 08:47:40.695246 dv-cinder-803823-12-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 08:47:40.704625 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:47:40 2022] *** Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: nodename: dv-cinder-803823-12-iscsi Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: machine: x86_64 Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: clock source: unix Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: pcre jit disabled Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: detected number of CPU cores: 4 Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: current working directory: / Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: your processes number limit is 47680 Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: your memory page size is 4096 bytes Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: detected max file descriptor number: 2048 Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: lock engine: pthread robust mutexes Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: thunder lock: enabled Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 08:47:40.706058 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:47:40.750320 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: Python main interpreter initialized at 0x5639a807b9c0 Jun 22 08:47:40.750320 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: python threads support enabled Jun 22 08:47:40.750320 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: your server socket listen backlog is limited to 100 connections Jun 22 08:47:40.750320 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:47:40.750716 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:47:40.750794 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: *** Operational MODE: preforking *** Jun 22 08:47:40.751039 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:47:40.751039 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: spawned uWSGI master process (pid: 80536) Jun 22 08:47:40.751248 dv-cinder-803823-12-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 08:47:40.754626 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: spawned uWSGI worker 1 (pid: 80550, cores: 1) Jun 22 08:47:40.754626 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: spawned uWSGI worker 2 (pid: 80551, cores: 1) Jun 22 08:47:40.754626 dv-cinder-803823-12-iscsi devstack@keystone.service[80536]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:47:46.245451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:47:46.245451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: from cryptography.utils import int_from_bytes Jun 22 08:47:46.246260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:47:46.246260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: from cryptography.utils import int_from_bytes Jun 22 08:47:46.246398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:47:46.246398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: from cryptography.utils import int_from_bytes Jun 22 08:47:46.246866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:47:46.246866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: from cryptography.utils import int_from_bytes Jun 22 08:47:46.293929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:47:46.294127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:47:46.294312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] command line args: [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:47:46.294434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:47:46.294580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:47:46.294659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:47:46.294740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ================================================================================ {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:47:46.294813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] command line args: [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:47:46.295020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] admin_token = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.295119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:47:46.295263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] config_dir = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.295342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ================================================================================ {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:47:46.295449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.295527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] admin_token = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.295630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] config_source = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.295754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] config_dir = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.295838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] debug = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.295946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] config_source = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] debug = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.296978 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.297652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.297781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.297880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] list_limit = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.297975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] log_config_append = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] list_limit = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] log_dir = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] log_config_append = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] log_file = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] log_dir = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.298913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] log_file = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.299959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.300949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.301960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] publish_errors = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.302946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] publish_errors = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] standard_threads = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.303934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] standard_threads = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] use_journal = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] use_json = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] use_stderr = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.304986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] use_journal = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.305064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] use_syslog = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.305166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] use_json = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.305251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.305400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] use_stderr = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.305474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.305551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] use_syslog = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.305669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.305753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:47:46.305927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.306989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.307968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.308915 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.309865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.310871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.311948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.312989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313213 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.313953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.314898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315099 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.315888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.316887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.317954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.318902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319825 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.319903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.320978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.321928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322477 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.322980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.323909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.324982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.325998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326699 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.326948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.327853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.328001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.328080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.328235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.328813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.328984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.329943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] auth.external = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.330926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] auth.external = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] auth.password = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] auth.token = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.331929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] auth.password = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] auth.token = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.332875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] credential.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.333968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] credential.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.334056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.334210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.334613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.334700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.334782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.334911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.334991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.335962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.336945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.337914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.338933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.339980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340376 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.340930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.341864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.342966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.343999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.344590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.344732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.344811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.344981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.345992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.346932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347334 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.347897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.348050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.348120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.348292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.348360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.348524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.348600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.350783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.351935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.352949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.353999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.354897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.355880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.356993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.357155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.357223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.357386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.357455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.358607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.358740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.358957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.359094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.359224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.359364 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.359492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.359652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.359783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.359911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.360038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.360174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.360301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.360433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.360561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.360687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.360815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.361919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.362046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.362422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.362546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.362673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.362808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.362950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363344 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.363989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.364115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.364253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.364380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.364506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.364632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.364758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.364894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] role.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] role.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.365924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.366975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] role.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] role.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.367998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.368138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.368265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.368402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.368526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.368652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.368778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.368912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.369932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.370977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.371115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.371241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.371369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.371495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.371620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.371758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.371933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.372949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.373915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.374993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.375122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.375259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.375386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.375513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.375640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.375776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.375901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.376928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.377989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.378127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.378253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.378379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.378506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.378633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.378769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.378921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.connection = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.379945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.380954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.381187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.connection = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.381323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.381461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.381660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.381787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.381912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.382977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.383108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.383246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.383373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.383500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.383627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.383753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.383881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:47:46.384156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:47:46.411322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.411550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.411773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.412314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.412548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.412781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.420212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.421407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.447716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.447942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.448949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.449185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.589689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.589864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.638772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.638950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.639075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.639171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.704271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.704495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.704620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.704707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.704856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.704942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.705082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.705166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.705302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.705395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.705521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.705740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.729741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.729975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.730996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.731071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.731163 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.731253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.742308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.742637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.755412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.755637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.755742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.755856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.755939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.756970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:47:46.774378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.774586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:47:46.774941 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.775027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.775141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:47:46.775239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:47:46.775407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.775490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.775660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:47:46.775742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.775909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.775992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.776158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.776239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.776418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.776668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.786943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.787214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.787474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.787555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.787746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.787844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.788042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.788322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.795953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.796590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.799249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.799524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.799798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.799925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.800068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.800205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.800337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.800487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.800589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.800769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.800850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.801922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.802107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.802378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.802641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.829049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.830635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.830767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.830931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.832475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.832753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.836142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.836527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.836801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.838009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.838403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.838684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.844108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.844344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.846049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.846332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.848800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.849078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.849354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.849627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.849895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.850161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.850422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.850680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.850844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.851124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.851404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.851683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.851956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.852228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.852495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.852759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.869534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.869809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.871641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.871945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.874375 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.877028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.878506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.878928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.880672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.881071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.883884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.886101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.887470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.889739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.891635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.891928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.892205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.892487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.892766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.893037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.893977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.894275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.894560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.894861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.895152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.895429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.911918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.912194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.912468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.912734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.914455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.914737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.915028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.915308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.920537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.922239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.922515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.923262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.924971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.925259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.925787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.926080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.926373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.926668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.926988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.928477 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.928756 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.929037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.929320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.929603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.940668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.940942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.941228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.941504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.943018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.943305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.943399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.943586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.943668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.943943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.944223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.945745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.946036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.946334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.961821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.964710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.965081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.968043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.968366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.970094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.971395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.971753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.972027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.972302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.973141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.974774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.975077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.975357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.979601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.981211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.982704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.984335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.984433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.984728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.985110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.985391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.987892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.988185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.988576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.988856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.994652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.994959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.995234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.998209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:46.998497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:46.998777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.003554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:47.003829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.004102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.004370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.004635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.005000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.005283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.005561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.005825 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.006088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.006349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.006608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.006890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.007160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.007241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:47:47.007454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.007730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.008001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.008270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.008653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.008937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.009209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.009488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.009771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.010041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.010311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.010575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.010866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:47:47.045403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5639a807b9c0 pid: 80550 (default app) Jun 22 08:47:47.048788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daad872-2620-4f16-9b38-c6d86b8af18d None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:47.049078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daad872-2620-4f16-9b38-c6d86b8af18d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:47.049357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daad872-2620-4f16-9b38-c6d86b8af18d None None] PATH_INFO: `/v3` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:47.049440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5639a807b9c0 pid: 80551 (default app) Jun 22 08:47:47.053465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Wed Jun 22 08:47:47 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:47:55.469430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbdf0a-54a3-42ae-850a-c1a475674671 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:55.470575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbdf0a-54a3-42ae-850a-c1a475674671 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:55.470575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbdf0a-54a3-42ae-850a-c1a475674671 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:55.474861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:47:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:47:55.480313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:55.480692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:55.480863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:55.549622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: INFO dbcounter [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] Registered counter for database keystone Jun 22 08:47:55.570336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG oslo_db.sqlalchemy.engines [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:47:55.576597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writer thread running {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:47:55.753780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG passlib.handlers.bcrypt [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80550) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 08:47:55.754187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG passlib.handlers.bcrypt [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80550) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 08:47:55.807823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:47:55.809405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:47:55.928615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:47:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 08:47:56.068014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbdf0a-54a3-42ae-850a-c1a475674671 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:47:56.139255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: INFO dbcounter [None req-31bbdf0a-54a3-42ae-850a-c1a475674671 None None] Registered counter for database keystone Jun 22 08:47:56.158063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG oslo_db.sqlalchemy.engines [None req-31bbdf0a-54a3-42ae-850a-c1a475674671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:47:56.164277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writer thread running {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:47:56.284608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbdf0a-54a3-42ae-850a-c1a475674671 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:47:56.288897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8eefa-3994-4d5c-ab77-ea0d8a56c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:47:56.289564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8eefa-3994-4d5c-ab77-ea0d8a56c090 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:56.289852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8eefa-3994-4d5c-ab77-ea0d8a56c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:56.290134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8eefa-3994-4d5c-ab77-ea0d8a56c090 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:56.298743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8eefa-3994-4d5c-ab77-ea0d8a56c090 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:47:56.350527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a3c8eefa-3994-4d5c-ab77-ea0d8a56c090 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 08:47:56.350814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8eefa-3994-4d5c-ab77-ea0d8a56c090 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:47:56.361644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jun 22 08:47:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:47:56.367909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:47:56.382718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6325b8-346e-48c1-98f0-c0345d57c356 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:47:56.387128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a506c-f045-4237-947a-abf770b74338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:47:56.388233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a506c-f045-4237-947a-abf770b74338 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:56.388521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a506c-f045-4237-947a-abf770b74338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:56.388799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a506c-f045-4237-947a-abf770b74338 admin admin] PATH_INFO: `/v3/projects/220b7f5f59544863b1dda75a37a7b01f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:56.390283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a506c-f045-4237-947a-abf770b74338 admin admin] RBAC: Authorizing `identity:get_project(project_id=220b7f5f59544863b1dda75a37a7b01f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:47:56.443046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d6a506c-f045-4237-947a-abf770b74338 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 08:47:56.443389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a506c-f045-4237-947a-abf770b74338 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:47:56.447900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Wed Jun 22 08:47:56 2022] GET /identity/v3/projects/220b7f5f59544863b1dda75a37a7b01f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:47:58.444681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fd616-17f0-4f3d-874e-35c938c126cc None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:58.445190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fd616-17f0-4f3d-874e-35c938c126cc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:58.445281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fd616-17f0-4f3d-874e-35c938c126cc None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:58.449309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:47:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:47:58.454702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a47ab-2107-4d76-9501-9c4ec734bb07 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:58.455145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a47ab-2107-4d76-9501-9c4ec734bb07 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:58.455290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a47ab-2107-4d76-9501-9c4ec734bb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:58.473549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f01a47ab-2107-4d76-9501-9c4ec734bb07 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:47:58.475072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f01a47ab-2107-4d76-9501-9c4ec734bb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:47:58.482738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:47:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 08:47:58.505723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fd616-17f0-4f3d-874e-35c938c126cc None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:47:58.517518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fd616-17f0-4f3d-874e-35c938c126cc None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:47:58.521629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7375e-2f25-492a-ace8-b742df041d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:47:58.522249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7375e-2f25-492a-ace8-b742df041d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:58.522533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7375e-2f25-492a-ace8-b742df041d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:58.522811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7375e-2f25-492a-ace8-b742df041d11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:58.530352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7375e-2f25-492a-ace8-b742df041d11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:47:58.532121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7375e-2f25-492a-ace8-b742df041d11 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:47:58.540726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jun 22 08:47:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:47:58.546486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a47ab-2107-4d76-9501-9c4ec734bb07 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:47:58.555303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a47ab-2107-4d76-9501-9c4ec734bb07 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:47:58.559598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca9afa-dd39-4c5e-8ca2-516229eeb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:47:58.560445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9afa-dd39-4c5e-8ca2-516229eeb028 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:47:58.560725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9afa-dd39-4c5e-8ca2-516229eeb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:47:58.561000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9afa-dd39-4c5e-8ca2-516229eeb028 admin admin] PATH_INFO: `/v3/users/980b07a4628a4a1da4fc1c5439c8f483` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:47:58.562369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca9afa-dd39-4c5e-8ca2-516229eeb028 admin admin] RBAC: Authorizing `identity:get_user(user_id=980b07a4628a4a1da4fc1c5439c8f483)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:47:58.564823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca9afa-dd39-4c5e-8ca2-516229eeb028 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:47:58.566363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Wed Jun 22 08:47:58 2022] GET /identity/v3/users/980b07a4628a4a1da4fc1c5439c8f483 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:00.640887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f8e7-a85a-4965-8601-b3dd7451fceb None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:00.641398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f8e7-a85a-4965-8601-b3dd7451fceb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:00.641398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f8e7-a85a-4965-8601-b3dd7451fceb None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:00.643284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:00.648313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2b82-da22-4510-a06d-b5fbae7828f9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:00.648727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2b82-da22-4510-a06d-b5fbae7828f9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:00.649003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2b82-da22-4510-a06d-b5fbae7828f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:00.666495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-accd2b82-da22-4510-a06d-b5fbae7828f9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:00.667771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-accd2b82-da22-4510-a06d-b5fbae7828f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:00.693436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcd2a-9a0f-4df4-be2b-b7aaf31c7c56 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:00.693721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcd2a-9a0f-4df4-be2b-b7aaf31c7c56 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:00.694002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bcd2a-9a0f-4df4-be2b-b7aaf31c7c56 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:00.695373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:00.700155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:00.700441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:00.700720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:00.740693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG passlib.handlers.bcrypt [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80551) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 08:48:00.741121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG passlib.handlers.bcrypt [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80551) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 08:48:00.748288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:00.771985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2b82-da22-4510-a06d-b5fbae7828f9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:00.787416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:00.789014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:00.794953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:00.873812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2b82-da22-4510-a06d-b5fbae7828f9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:00.887698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:00.906286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:00.907043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:00.907917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:00.908195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:00.910912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:00.920091 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:00.931130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:00.932237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:00.933541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:00.937870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:01.014247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a952d03-852a-49e7-81d3-f5f0357efe0c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:01.017256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:01.021424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:01.039324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3e480-fc98-46a3-9e51-207f0ac20ddd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:01.050640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:01.051570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:01.051864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:01.052150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:01.072976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:01.073644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:01.073933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:01.074220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:01.075012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:01.075322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:01.076706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:01.088822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:01.094256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:01.120330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:01.121856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:01.190946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dc0c9-689a-4b25-96b8-bc4a11b437ed None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:01.217996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:48:01.223657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:01.224986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:01.225860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:01.226148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:01.226331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:01.226433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] PATH_INFO: `/v3/users/980b07a4628a4a1da4fc1c5439c8f483` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:01.228192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] RBAC: Authorizing `identity:get_user(user_id=980b07a4628a4a1da4fc1c5439c8f483)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:01.229648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:01.232068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 9/17] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:01 2022] GET /identity/v3/users/980b07a4628a4a1da4fc1c5439c8f483 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:01.237701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:01.252162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:01.321858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643c60d-ee55-417a-a87f-f5ed797a0a51 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:01.335518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d53ce-1b06-420f-8187-8c578f5eb4a4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:01.357274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:01.358583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:01.358583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:01.358755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:01.370616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:01.371435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:01.371724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:01.371998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:01.373173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:01.374643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:01.376514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:01.381552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:01.381887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:01.383045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:48:01.404251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:01.405081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:01.406035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:48:01.406035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:48:01.406035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:48:01.406035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:01.406035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:01.411639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:01.461056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:01.466163 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:01.479919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d9176-c74a-44b4-bcfc-8babaee5638a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:01.508328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4c02-8f71-4aed-b15f-08285f824f2e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:01.513226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b35f26-570b-4a49-9c3e-7e7aa0109b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:01.513889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b35f26-570b-4a49-9c3e-7e7aa0109b4b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:01.514178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b35f26-570b-4a49-9c3e-7e7aa0109b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:01.514459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b35f26-570b-4a49-9c3e-7e7aa0109b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:01.515367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b35f26-570b-4a49-9c3e-7e7aa0109b4b None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.domain.id=default, user.id=980b07a4628a4a1da4fc1c5439c8f483) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:01.515684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b35f26-570b-4a49-9c3e-7e7aa0109b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:01.517662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b35f26-570b-4a49-9c3e-7e7aa0109b4b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:01.525280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jun 22 08:48:01 2022] GET /identity/v3/role_assignments?user.id=980b07a4628a4a1da4fc1c5439c8f483&scope.domain.id=default&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:01.542784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f19d6d-6a37-4442-8f43-c6a0b783a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:01.543534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19d6d-6a37-4442-8f43-c6a0b783a2db None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:01.543973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19d6d-6a37-4442-8f43-c6a0b783a2db None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:01.544254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19d6d-6a37-4442-8f43-c6a0b783a2db None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:01.545008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f19d6d-6a37-4442-8f43-c6a0b783a2db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:01.545319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f19d6d-6a37-4442-8f43-c6a0b783a2db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:01.546750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f19d6d-6a37-4442-8f43-c6a0b783a2db None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:01.566306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:03.869829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb4849-9d97-4bc8-b0ae-806986999d4a None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:03.870366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb4849-9d97-4bc8-b0ae-806986999d4a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:03.870366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb4849-9d97-4bc8-b0ae-806986999d4a None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:03.871777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:03.877818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e55561-b611-4a99-a781-2699ccc14047 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:03.878209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e55561-b611-4a99-a781-2699ccc14047 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:03.878391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e55561-b611-4a99-a781-2699ccc14047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:03.903819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-09e55561-b611-4a99-a781-2699ccc14047 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:03.905048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-09e55561-b611-4a99-a781-2699ccc14047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:03.975973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d6b6e-fa14-487e-9516-09b61b67a547 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:03.976301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d6b6e-fa14-487e-9516-09b61b67a547 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:03.976547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d6b6e-fa14-487e-9516-09b61b67a547 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:03.978026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 13/23] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:03.989118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703d93d-2380-49e7-973d-8bf4c6075bcb None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:03.989412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703d93d-2380-49e7-973d-8bf4c6075bcb None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:03.989695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703d93d-2380-49e7-973d-8bf4c6075bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.001574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 11/24] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:04.017713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814cfa1-227f-4b62-9a07-ccaad00a007a None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.018314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d703d93d-2380-49e7-973d-8bf4c6075bcb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:04.019082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814cfa1-227f-4b62-9a07-ccaad00a007a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.020039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d703d93d-2380-49e7-973d-8bf4c6075bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:04.020378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814cfa1-227f-4b62-9a07-ccaad00a007a None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.022106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 12/25] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:04.027688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c615bc-e62e-4c87-85a4-e6bb39d4995f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.027984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c615bc-e62e-4c87-85a4-e6bb39d4995f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.028274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c615bc-e62e-4c87-85a4-e6bb39d4995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.058689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-86c615bc-e62e-4c87-85a4-e6bb39d4995f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:04.059949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-86c615bc-e62e-4c87-85a4-e6bb39d4995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:04.122471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:04.173766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 14/26] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:04.175359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 13/27] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:04.176424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703d93d-2380-49e7-973d-8bf4c6075bcb None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:04.199009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c615bc-e62e-4c87-85a4-e6bb39d4995f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:04.339461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:04.366935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c615bc-e62e-4c87-85a4-e6bb39d4995f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:04.411895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:04.413023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.413504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.415804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703d93d-2380-49e7-973d-8bf4c6075bcb None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:04.416310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.437335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:04.442193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:48:04.464660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:04.465506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:04.466360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:48:04.466360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:48:04.466360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:48:04.466360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:04.468591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 14/28] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:04.469740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:04.514398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:04.518576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.519095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.519574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.538697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:04.547489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:04.558908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:04.559789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 15/29] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:04.560995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:04.644453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a4b84-7f08-47f4-8d88-584e9c6092b0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:04.690795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489d9fa-d74d-49a5-b185-0db3b861917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:04.691728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489d9fa-d74d-49a5-b185-0db3b861917b None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.692301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489d9fa-d74d-49a5-b185-0db3b861917b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.692718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489d9fa-d74d-49a5-b185-0db3b861917b None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.694883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489d9fa-d74d-49a5-b185-0db3b861917b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:04.697855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489d9fa-d74d-49a5-b185-0db3b861917b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:04.728701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e28569-2f37-4172-9c3e-28455f161c38 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:04.767321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:04.767984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.768274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.768558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.769303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:04.769616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:04.771110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:04.773084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:04.792028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 16/30] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:04.792937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:04.911593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdad1f-5c42-49a1-920f-4348befbdffe None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:04.913474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 15/31] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 22 08:48:04 2022] POST /identity/v3/roles => generated 219 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:04.915120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b396-776b-4985-94d5-196490643bcb None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.915410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b396-776b-4985-94d5-196490643bcb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.916436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b396-776b-4985-94d5-196490643bcb None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.917367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 16/32] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:04.917903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b396-776b-4985-94d5-196490643bcb None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:04.960888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0943aa-0d7f-4a6c-a653-f60df7a5d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:04.962050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0943aa-0d7f-4a6c-a653-f60df7a5d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.962549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0943aa-0d7f-4a6c-a653-f60df7a5d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.963878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0943aa-0d7f-4a6c-a653-f60df7a5d0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:04.964843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0943aa-0d7f-4a6c-a653-f60df7a5d0b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:04.965343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0943aa-0d7f-4a6c-a653-f60df7a5d0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:04.966976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0943aa-0d7f-4a6c-a653-f60df7a5d0b3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:04.979552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 17/33] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:04.981580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf37a-57e1-490b-986f-b4096ea67d24 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:04.982092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf37a-57e1-490b-986f-b4096ea67d24 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:04.982567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf37a-57e1-490b-986f-b4096ea67d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.003764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2d8bf37a-57e1-490b-986f-b4096ea67d24 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:05.005001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2d8bf37a-57e1-490b-986f-b4096ea67d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:05.031211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:05.050386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b396-776b-4985-94d5-196490643bcb None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:05.065604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:05.084390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 18/34] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:05.085165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bf37a-57e1-490b-986f-b4096ea67d24 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:05.098206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:05.099257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.099771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.100271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.102094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:05.103964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:05.231589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 17/35] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:48:04 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:05.232347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:05.237932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bf37a-57e1-490b-986f-b4096ea67d24 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:05.285209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:05.286614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.287165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.287705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] PATH_INFO: `/v3/users/980b07a4628a4a1da4fc1c5439c8f483` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.289785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] RBAC: Authorizing `identity:get_user(user_id=980b07a4628a4a1da4fc1c5439c8f483)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:05.292079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:05.294172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 19/36] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:05 2022] GET /identity/v3/users/980b07a4628a4a1da4fc1c5439c8f483 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:05.304231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:05.393650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac840ecb-4bfb-456b-be27-3aef5f9fddc7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:05.433623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124f2ca-2da4-48d3-a55a-01efcafb7a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:05.434370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f2ca-2da4-48d3-a55a-01efcafb7a1d None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.434661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f2ca-2da4-48d3-a55a-01efcafb7a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.435010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f2ca-2da4-48d3-a55a-01efcafb7a1d None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.435785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124f2ca-2da4-48d3-a55a-01efcafb7a1d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:05.437499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124f2ca-2da4-48d3-a55a-01efcafb7a1d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:05.438011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:05.472870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d2ecf-5c1b-4e9e-bd44-3619949316cf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:05.506746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:05.509717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e64d84-d31b-4005-8576-08eb9e0a0e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:05.510545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e64d84-d31b-4005-8576-08eb9e0a0e3a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.511082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e64d84-d31b-4005-8576-08eb9e0a0e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.511082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e64d84-d31b-4005-8576-08eb9e0a0e3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.512297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e64d84-d31b-4005-8576-08eb9e0a0e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:05.513820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e64d84-d31b-4005-8576-08eb9e0a0e3a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:05.515602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 22 08:48:05 2022] POST /identity/v3/roles => generated 225 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:05.518650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a51e-b5e2-4624-b8ab-27ccb7356f73 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.518991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a51e-b5e2-4624-b8ab-27ccb7356f73 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.519288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a51e-b5e2-4624-b8ab-27ccb7356f73 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.520647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 19/38] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:05.521146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 20/39] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:05.523067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a51e-b5e2-4624-b8ab-27ccb7356f73 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:05.527675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad988f61-e0fb-4741-ac73-4e7df9daec08 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.527967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad988f61-e0fb-4741-ac73-4e7df9daec08 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.528261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad988f61-e0fb-4741-ac73-4e7df9daec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.548730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ad988f61-e0fb-4741-ac73-4e7df9daec08 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:05.549987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ad988f61-e0fb-4741-ac73-4e7df9daec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:05.629129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 21/40] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:05.630494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000c150-a7fb-46e4-90b3-b3b75cab0d10 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.631004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000c150-a7fb-46e4-90b3-b3b75cab0d10 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.631293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000c150-a7fb-46e4-90b3-b3b75cab0d10 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.632796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 22/41] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:05.638357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431130-8ba5-487b-b35b-2d51b95a9ee2 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.638653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431130-8ba5-487b-b35b-2d51b95a9ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.638973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431130-8ba5-487b-b35b-2d51b95a9ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.654146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a51e-b5e2-4624-b8ab-27ccb7356f73 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:05.657422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f4431130-8ba5-487b-b35b-2d51b95a9ee2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:05.659003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f4431130-8ba5-487b-b35b-2d51b95a9ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:05.696011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:05.696919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.697214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.697474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] PATH_INFO: `/v3/domains/default/users/980b07a4628a4a1da4fc1c5439c8f483/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.699846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=980b07a4628a4a1da4fc1c5439c8f483, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:05.701328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:05.717174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:05.738688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 23/42] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:05.739570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431130-8ba5-487b-b35b-2d51b95a9ee2 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:05.798289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 20/43] 10.222.0.55 () {58 vars in 1361 bytes} [Wed Jun 22 08:48:05 2022] PUT /identity/v3/domains/default/users/980b07a4628a4a1da4fc1c5439c8f483/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:05.799379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:05.841930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431130-8ba5-487b-b35b-2d51b95a9ee2 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:05.869630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:05.881098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae203a-71d6-4aeb-98e2-ae88540487c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:05.881843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae203a-71d6-4aeb-98e2-ae88540487c8 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.882135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae203a-71d6-4aeb-98e2-ae88540487c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.883190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae203a-71d6-4aeb-98e2-ae88540487c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.883190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae203a-71d6-4aeb-98e2-ae88540487c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:05.884609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae203a-71d6-4aeb-98e2-ae88540487c8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:05.915005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a21a5-1cfe-4dc3-884b-560391c714de None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:05.953648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:05.955161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:05.955461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:05.955747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:05.957126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:05.958648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:05.960514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 21/44] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:05.965812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:06.085005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144aa4-23d7-4c21-82cb-2a9a2ad2563c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:06.114214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:06.122549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa58e-4246-4f13-ac23-bf73b8c475a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:06.123251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa58e-4246-4f13-ac23-bf73b8c475a3 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:06.123542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa58e-4246-4f13-ac23-bf73b8c475a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:06.123825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa58e-4246-4f13-ac23-bf73b8c475a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:06.126955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa58e-4246-4f13-ac23-bf73b8c475a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:06.126955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa58e-4246-4f13-ac23-bf73b8c475a3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:06.193221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 24/45] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 22 08:48:05 2022] POST /identity/v3/roles => generated 223 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:06.254857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 22/46] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:48:05 2022] POST /identity/v3/projects => generated 312 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:48:07.847760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1658441-54b9-4623-a2a0-7ba76bdbf4c4 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:07.848275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1658441-54b9-4623-a2a0-7ba76bdbf4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:07.848375 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1658441-54b9-4623-a2a0-7ba76bdbf4c4 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:07.849669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 25/47] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:07.854858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d650c5-414f-49e9-b5e7-ae509a937945 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:07.855277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d650c5-414f-49e9-b5e7-ae509a937945 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:07.855416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d650c5-414f-49e9-b5e7-ae509a937945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:07.872803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e5d650c5-414f-49e9-b5e7-ae509a937945 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:07.874310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e5d650c5-414f-49e9-b5e7-ae509a937945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:07.939545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 23/48] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:07.963005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1658441-54b9-4623-a2a0-7ba76bdbf4c4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:08.008400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:08.063660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1658441-54b9-4623-a2a0-7ba76bdbf4c4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:08.097507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:08.098353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.098587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.098896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.108806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:08.116545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:08.117379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:08.118354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 26/49] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:08.123481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d650c5-414f-49e9-b5e7-ae509a937945 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:08.219903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d650c5-414f-49e9-b5e7-ae509a937945 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:08.230268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:08.252473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e2469-7920-45cc-8881-4eb40b4bae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:08.253197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e2469-7920-45cc-8881-4eb40b4bae70 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.253421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e2469-7920-45cc-8881-4eb40b4bae70 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.253732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e2469-7920-45cc-8881-4eb40b4bae70 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.254453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e2469-7920-45cc-8881-4eb40b4bae70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:08.254759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e2469-7920-45cc-8881-4eb40b4bae70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:08.256165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e2469-7920-45cc-8881-4eb40b4bae70 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:08.269480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 24/50] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:08.274953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:08.286559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0eca0-a116-4f30-b8d7-7247ebabc8b2 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.286870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0eca0-a116-4f30-b8d7-7247ebabc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.287151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0eca0-a116-4f30-b8d7-7247ebabc8b2 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.289007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 25/51] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:08.293473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99b607-7b7b-4f22-8466-b1d6ebae0d71 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.293766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99b607-7b7b-4f22-8466-b1d6ebae0d71 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.294052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99b607-7b7b-4f22-8466-b1d6ebae0d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.382838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb32429-c7cb-4cba-9541-b810aacf4c23 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:08.384537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:08.415725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3b99b607-7b7b-4f22-8466-b1d6ebae0d71 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:08.416953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3b99b607-7b7b-4f22-8466-b1d6ebae0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:08.419583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:08.420468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.420754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.421034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] PATH_INFO: `/v3/users/980b07a4628a4a1da4fc1c5439c8f483` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.422337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=980b07a4628a4a1da4fc1c5439c8f483)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:08.423960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:08.425596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 27/52] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:08 2022] GET /identity/v3/users/980b07a4628a4a1da4fc1c5439c8f483 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:08.430919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:08.484360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 26/53] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:08.507918 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99b607-7b7b-4f22-8466-b1d6ebae0d71 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:08.529271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fb81-2652-4532-bd08-6956f424a6e7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:08.562510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:08.563877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.564168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.564448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.565725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:08.567197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:08.568805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 28/54] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:08.574464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:08.604622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99b607-7b7b-4f22-8466-b1d6ebae0d71 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:08.606064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:08.614411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:08.638471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:08.639291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.639578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.639854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.641031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:08.643167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:08.644646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:08.650020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:08.674162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ac44-3232-4dd7-bfc7-7bca0c85e25d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:08.708407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ee4c1-bf32-40a2-ae3c-820988e9ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:08.709068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee4c1-bf32-40a2-ae3c-820988e9ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.709358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee4c1-bf32-40a2-ae3c-820988e9ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.709642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee4c1-bf32-40a2-ae3c-820988e9ebc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.710480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ee4c1-bf32-40a2-ae3c-820988e9ebc1 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.domain.id=default, user.id=980b07a4628a4a1da4fc1c5439c8f483) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:08.710848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ee4c1-bf32-40a2-ae3c-820988e9ebc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:08.712375 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ee4c1-bf32-40a2-ae3c-820988e9ebc1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:08.718340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 29/56] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jun 22 08:48:08 2022] GET /identity/v3/role_assignments?user.id=980b07a4628a4a1da4fc1c5439c8f483&scope.domain.id=default&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:08.752859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1228eb8-1b7b-4fea-8798-9f32d2b79406 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:08.789104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696bb21-d195-4aea-9774-a9dfb31477ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:08.789777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bb21-d195-4aea-9774-a9dfb31477ce None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:08.790063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bb21-d195-4aea-9774-a9dfb31477ce None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:08.790342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bb21-d195-4aea-9774-a9dfb31477ce None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:08.791096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696bb21-d195-4aea-9774-a9dfb31477ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:08.792568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696bb21-d195-4aea-9774-a9dfb31477ce None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:08.916108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 28/57] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jun 22 08:48:08 2022] POST /identity/v3/projects => generated 298 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:48:10.912618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e690d-d3bc-4872-9fe6-3441480003ae None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:10.913131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e690d-d3bc-4872-9fe6-3441480003ae None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:10.913214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e690d-d3bc-4872-9fe6-3441480003ae None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:10.914559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 30/58] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:10.919571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ebe5-f437-41ca-b43a-e96ff21a0992 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:10.919932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ebe5-f437-41ca-b43a-e96ff21a0992 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:10.920145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3ebe5-f437-41ca-b43a-e96ff21a0992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:10.937017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-11c3ebe5-f437-41ca-b43a-e96ff21a0992 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:10.938236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-11c3ebe5-f437-41ca-b43a-e96ff21a0992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:10.954048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:11.002440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 29/59] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:11.026064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e690d-d3bc-4872-9fe6-3441480003ae None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:11.128118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e690d-d3bc-4872-9fe6-3441480003ae None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:11.129601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:11.161762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4c290-e231-4489-a838-7c4c6b9312f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:11.162541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c290-e231-4489-a838-7c4c6b9312f8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:11.162906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c290-e231-4489-a838-7c4c6b9312f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:11.163130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c290-e231-4489-a838-7c4c6b9312f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:11.164278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4c290-e231-4489-a838-7c4c6b9312f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:11.165725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4c290-e231-4489-a838-7c4c6b9312f8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:11.167333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 31/60] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:11.173038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3ebe5-f437-41ca-b43a-e96ff21a0992 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:11.267200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3ebe5-f437-41ca-b43a-e96ff21a0992 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:11.299472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbbf57-dc99-4fd1-8b08-935080e311d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:11.300129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbbf57-dc99-4fd1-8b08-935080e311d0 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:11.300416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbbf57-dc99-4fd1-8b08-935080e311d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:11.300698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbbf57-dc99-4fd1-8b08-935080e311d0 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:11.301412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbbf57-dc99-4fd1-8b08-935080e311d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:11.302884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbbf57-dc99-4fd1-8b08-935080e311d0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:11.416659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 30/61] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:48:11 2022] POST /identity/v3/users => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:48:14.471062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348df8c-606a-4c96-9b32-dfba8ed1624c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.472084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348df8c-606a-4c96-9b32-dfba8ed1624c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.472590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348df8c-606a-4c96-9b32-dfba8ed1624c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.474176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 32/62] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:14.479703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0dbd-288f-4152-8a6c-613bec00fdd4 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.480171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0dbd-288f-4152-8a6c-613bec00fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.480360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a0dbd-288f-4152-8a6c-613bec00fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.502699 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9c8a0dbd-288f-4152-8a6c-613bec00fdd4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:14.503920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9c8a0dbd-288f-4152-8a6c-613bec00fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:14.505988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:14.589840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 31/63] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:14.626727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348df8c-606a-4c96-9b32-dfba8ed1624c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:14.679835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a5cd-26ce-43a4-a386-8717f41b54a2 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.680145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a5cd-26ce-43a4-a386-8717f41b54a2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.680424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a5cd-26ce-43a4-a386-8717f41b54a2 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.681960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 32/64] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:14.686943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c3cc-070d-45f9-b391-a118312216a1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.687242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c3cc-070d-45f9-b391-a118312216a1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.687632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c3cc-070d-45f9-b391-a118312216a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.705071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b628c3cc-070d-45f9-b391-a118312216a1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:14.706589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b628c3cc-070d-45f9-b391-a118312216a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:14.772152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348df8c-606a-4c96-9b32-dfba8ed1624c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:14.812440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 33/65] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:14.813476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:14.814277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:14.814563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:14.814853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:14.825514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:14.833715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:14.834796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:14.835605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 33/66] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:14.842378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628c3cc-070d-45f9-b391-a118312216a1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:14.852450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:14.915294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:14.945010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.002853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628c3cc-070d-45f9-b391-a118312216a1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.024906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff25be-1f7a-40b8-a505-a22a7d0b50ed None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.038857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fb613-c96d-4fc4-844a-5a51725a2149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.039552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb613-c96d-4fc4-844a-5a51725a2149 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.039841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb613-c96d-4fc4-844a-5a51725a2149 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.040124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb613-c96d-4fc4-844a-5a51725a2149 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.040879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fb613-c96d-4fc4-844a-5a51725a2149 None admin] RBAC: Adding query filter params (name=member) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:15.041195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fb613-c96d-4fc4-844a-5a51725a2149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.042580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fb613-c96d-4fc4-844a-5a51725a2149 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.051092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 34/67] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:15.052346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac92e7b-2d97-4463-9ea9-b3079fbdbd08 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.052641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac92e7b-2d97-4463-9ea9-b3079fbdbd08 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.052925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac92e7b-2d97-4463-9ea9-b3079fbdbd08 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.058292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 35/68] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:15.058292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea73c-8e2c-4117-ba17-e028728c02ab None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.058292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea73c-8e2c-4117-ba17-e028728c02ab None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.058292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea73c-8e2c-4117-ba17-e028728c02ab None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.058950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 36/69] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:15.059711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dea73c-8e2c-4117-ba17-e028728c02ab None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.070843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ae6af-bf18-490c-b930-0f146fd5889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.072229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae6af-bf18-490c-b930-0f146fd5889e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.072721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae6af-bf18-490c-b930-0f146fd5889e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.073241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ae6af-bf18-490c-b930-0f146fd5889e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.085540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ae6af-bf18-490c-b930-0f146fd5889e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-063ae6af-bf18-490c-b930-0f146fd5889e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:15.093076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:15.094536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:15.095352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 34/70] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:15.096462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5f892-d407-478a-bbd8-6420b481b9c5 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.096462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5f892-d407-478a-bbd8-6420b481b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.096577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5f892-d407-478a-bbd8-6420b481b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.113774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-73c5f892-d407-478a-bbd8-6420b481b9c5 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.115309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-73c5f892-d407-478a-bbd8-6420b481b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.177036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dea73c-8e2c-4117-ba17-e028728c02ab None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.189834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 35/71] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:15.191373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca05d3-a215-470d-afa4-b8c69effe2ec None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.191667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca05d3-a215-470d-afa4-b8c69effe2ec None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.192329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca05d3-a215-470d-afa4-b8c69effe2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.206643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.211930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-62ca05d3-a215-470d-afa4-b8c69effe2ec None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.212048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.212851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.213126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-62ca05d3-a215-470d-afa4-b8c69effe2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.213220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.213403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.227980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.228786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.230229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.231941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 37/72] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:15.232698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.282060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 36/73] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:15.283472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548689b-b493-4e57-bb59-78c6cef3c850 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.283775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548689b-b493-4e57-bb59-78c6cef3c850 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.284057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548689b-b493-4e57-bb59-78c6cef3c850 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.285331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 37/74] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:15.286033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548689b-b493-4e57-bb59-78c6cef3c850 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.344636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2514b-a3ea-4c68-b805-06aa6ae2ccde None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.379542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.380220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.380510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.380791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.381550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:15.381862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.383284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.391608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548689b-b493-4e57-bb59-78c6cef3c850 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.391958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:15.392768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.426449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afb253-722c-48d3-85ba-86a01be63dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.427339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb253-722c-48d3-85ba-86a01be63dec None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.427574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb253-722c-48d3-85ba-86a01be63dec None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.427849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb253-722c-48d3-85ba-86a01be63dec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.438467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afb253-722c-48d3-85ba-86a01be63dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:15.443612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f5afb253-722c-48d3-85ba-86a01be63dec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:15.446275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:15.447354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:15.448322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 38/76] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:15.451267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292897f-fb31-486c-a833-d829e5004e5c None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.451571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292897f-fb31-486c-a833-d829e5004e5c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.451864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292897f-fb31-486c-a833-d829e5004e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.469178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c292897f-fb31-486c-a833-d829e5004e5c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:15.470386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c292897f-fb31-486c-a833-d829e5004e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:15.473184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.496251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726479aa-ebc8-4924-98bf-7c5bb603b194 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.530989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.531666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.531957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.532241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.536862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 39/77] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:15.539686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292897f-fb31-486c-a833-d829e5004e5c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.600040 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.601518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.638023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292897f-fb31-486c-a833-d829e5004e5c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.649715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.670132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.670948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.671234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.671538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.679940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.682724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:15.694182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:15.695281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:15.696052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 40/78] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:15.696680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.704538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 39/79] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:15.705397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.798297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4d03-daf0-43ff-9dde-59e73c5e6276 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.803813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb372b-83cf-4970-87a0-99d17254a139 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.831431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.832305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.832594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.832876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] PATH_INFO: `/v3/users/980b07a4628a4a1da4fc1c5439c8f483` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.834064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] RBAC: Authorizing `identity:get_user(user_id=980b07a4628a4a1da4fc1c5439c8f483)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.835541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.836930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.837162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 41/80] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/users/980b07a4628a4a1da4fc1c5439c8f483 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:15.837597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.837880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.837965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.838197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.838926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:15.839234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.840574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.848494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 40/81] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:15.851738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.866980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.908445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:15.941607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e01e6-92fa-442a-8723-2042ab3685d4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.952995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f65f-4985-4fbe-8d84-1c7f7fc1a15a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:15.976371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.977153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.977438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.977715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.978897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.980336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:15.982081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 42/82] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:15.982682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:15.990935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:15.991597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:15.991882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:15.992161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:15.992907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:15.993221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:15.994596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.002753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 41/83] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.003596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.080205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.088319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574c688-aea9-4125-9f0e-126951111584 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.104730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bef7a3-4c2f-4289-8b12-501af8007e98 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.127235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.128092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.128380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.128662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.129862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.131496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.133275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 43/84] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:15 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.133275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.138223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.145397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.146048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.146329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.146632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.214143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.215592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.232325 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0533506-6560-4626-9ae6-9f1ab398a0bd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.265115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.266719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.267036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.267346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.268549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.270011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.271794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 44/85] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.272421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.287803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.312577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 42/86] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:16.313994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.345553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.377795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b581564-33a7-40ad-a412-f1e335e0310f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.411388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.412064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.412364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.412649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.413372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.414852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.416119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02898cce-b48f-4565-b3ae-6ac2d3c21525 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.450472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.451369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.451657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.451938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.453140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.454601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.456300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 43/87] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.457056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.498647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.508355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 45/88] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:48:16 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:16.509286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.563553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d5607-fc65-45d1-ac44-2a4bc44403da None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.604389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.605075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.605372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.605653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.606515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=874eba2718e1486988bc2175440805ce) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:16.606858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.608349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.617393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 44/89] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/role_assignments?user.id=874eba2718e1486988bc2175440805ce&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.628107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.638567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a5f2d-a88c-45e8-9eeb-bebf7cbab865 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.671116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.682023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.682706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.688608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.688608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.778318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cab39-19a6-429d-991e-5ed3e1b98e08 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.785567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.787190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.792365 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:16.820732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:16.821633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:16.821921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:16.822199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:16.823442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:16.824905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:16.827063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 45/90] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:16.828036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.930982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 46/91] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:16.932226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:16.961391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a7756-f447-4a9b-8f9a-06af5dccc253 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:16.969678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.003244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.004425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.004919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.005394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.053736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.068959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd4779-e2e7-4f23-b85c-920fa8b09d25 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.080632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.082431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.114445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.116789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.117962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.118610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.121105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=980b07a4628a4a1da4fc1c5439c8f483) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:17.122407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.124844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.136396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 47/92] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/role_assignments?user.id=980b07a4628a4a1da4fc1c5439c8f483&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:17.146857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.309924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 46/93] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:17.314495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.316005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.334947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef142c4d-2591-45f4-8035-b549572e301a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.407621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.408499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.408787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.409068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.410317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.416562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.418650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 48/94] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:17.427566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.460022 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:17.510999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ffbb0-7e36-4a7a-b6e1-4b16dc2daf07 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.576996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.577797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.578085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.578961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] PATH_INFO: `/v3/projects/c348f82427f44c71aae64898f6b6b21f` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.582413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] RBAC: Authorizing `identity:get_project(project_id=c348f82427f44c71aae64898f6b6b21f)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.583946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.586657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 47/95] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/projects/c348f82427f44c71aae64898f6b6b21f => generated 312 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:17.591245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:17.622234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dee59-bbdc-4dbc-a408-fa6df4163d28 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.695550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2974459-9075-4801-b298-2aa422538ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.696229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2974459-9075-4801-b298-2aa422538ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.696515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2974459-9075-4801-b298-2aa422538ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.696794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2974459-9075-4801-b298-2aa422538ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.697641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2974459-9075-4801-b298-2aa422538ed0 None admin] RBAC: Adding query filter params (role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=874eba2718e1486988bc2175440805ce) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:17.697955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2974459-9075-4801-b298-2aa422538ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.699427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2974459-9075-4801-b298-2aa422538ed0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.715307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 49/96] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/role_assignments?user.id=874eba2718e1486988bc2175440805ce&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:17.756982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1b778-5691-4c56-84d0-fd7e55738be6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:17.810034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d7b2-9312-4149-88e9-320ddbe4b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:17.810732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d7b2-9312-4149-88e9-320ddbe4b6bb None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:17.811049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d7b2-9312-4149-88e9-320ddbe4b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:17.811334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d7b2-9312-4149-88e9-320ddbe4b6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:17.812215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d7b2-9312-4149-88e9-320ddbe4b6bb None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=c348f82427f44c71aae64898f6b6b21f, user.id=874eba2718e1486988bc2175440805ce) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:17.812639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d7b2-9312-4149-88e9-320ddbe4b6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:17.814642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d7b2-9312-4149-88e9-320ddbe4b6bb None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:17.825570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 48/97] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:17 2022] GET /identity/v3/role_assignments?user.id=874eba2718e1486988bc2175440805ce&scope.project.id=c348f82427f44c71aae64898f6b6b21f&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:19.075851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb08e7-fde1-4548-a2ca-df9c6bd28aa2 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.076386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb08e7-fde1-4548-a2ca-df9c6bd28aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.076386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb08e7-fde1-4548-a2ca-df9c6bd28aa2 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.077777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 50/98] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:19.083859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35e24-fe93-4106-895c-870c4353e387 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.084270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35e24-fe93-4106-895c-870c4353e387 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.084457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35e24-fe93-4106-895c-870c4353e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.103309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:19.111794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fca35e24-fe93-4106-895c-870c4353e387 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:19.113305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fca35e24-fe93-4106-895c-870c4353e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:19.197587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 49/99] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:19.240612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb08e7-fde1-4548-a2ca-df9c6bd28aa2 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.269355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:19.367894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb08e7-fde1-4548-a2ca-df9c6bd28aa2 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.416755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.417622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.417916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.418202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.435093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:19.438290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99321522-2f2c-4bca-b833-f62d3f9e2f64 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.438592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99321522-2f2c-4bca-b833-f62d3f9e2f64 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.438920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99321522-2f2c-4bca-b833-f62d3f9e2f64 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.440307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 50/100] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:19.445256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:19.446106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:19.446914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:19.448345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c0a4-828a-4c12-83e4-7640119227ac None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.448345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c0a4-828a-4c12-83e4-7640119227ac None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.448345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c0a4-828a-4c12-83e4-7640119227ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.448613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 51/101] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:19.454090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.474021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-7a37c0a4-828a-4c12-83e4-7640119227ac None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:19.475266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7a37c0a4-828a-4c12-83e4-7640119227ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:19.581616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 51/102] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:19.602434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:19.623515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3432ac-ee19-46bf-b8eb-d3d5d38786aa None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.646399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c0a4-828a-4c12-83e4-7640119227ac None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.688986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.690056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.690520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.691008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.691940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:19.692425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.693986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.712629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 52/103] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:19.720386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.727181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:19.773678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c0a4-828a-4c12-83e4-7640119227ac None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.843545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26475-d4a4-4782-bc84-65fb06243859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.844891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26475-d4a4-4782-bc84-65fb06243859 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.845176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26475-d4a4-4782-bc84-65fb06243859 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.845454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26475-d4a4-4782-bc84-65fb06243859 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.879031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd26475-d4a4-4782-bc84-65fb06243859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-6bd26475-d4a4-4782-bc84-65fb06243859 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:19.887793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:19.888640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:19.889420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:19.889999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f126f-ea95-446e-9b63-0dee9031c428 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:19.890070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 52/104] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:19.890274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8ac79-1b74-4723-9788-2034af2812bf None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.891424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8ac79-1b74-4723-9788-2034af2812bf None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.891424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8ac79-1b74-4723-9788-2034af2812bf None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.892415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 53/105] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:19.899694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8ac79-1b74-4723-9788-2034af2812bf None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:19.925544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c6a7d-dbb8-411c-abd0-7790553590d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:19.926560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c6a7d-dbb8-411c-abd0-7790553590d7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.926998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c6a7d-dbb8-411c-abd0-7790553590d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.927283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c6a7d-dbb8-411c-abd0-7790553590d7 None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.935618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c6a7d-dbb8-411c-abd0-7790553590d7 None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:19.937093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c6a7d-dbb8-411c-abd0-7790553590d7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:19.939132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 53/106] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:19.940139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a009c-8f21-4373-bbf1-4ba7c7a1e6b5 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:19.940459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a009c-8f21-4373-bbf1-4ba7c7a1e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:19.940716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a009c-8f21-4373-bbf1-4ba7c7a1e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:19.970659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a80a009c-8f21-4373-bbf1-4ba7c7a1e6b5 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:19.971886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a80a009c-8f21-4373-bbf1-4ba7c7a1e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:19.989685 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.065066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8ac79-1b74-4723-9788-2034af2812bf None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.110134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 54/107] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:20.111023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a009c-8f21-4373-bbf1-4ba7c7a1e6b5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.115205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.123797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.124483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.124777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.125111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.125964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:20.126342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.127741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.143600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 54/108] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:20.149014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.221285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a009c-8f21-4373-bbf1-4ba7c7a1e6b5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.256965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.258097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.258524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.258970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.260979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.263077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.266481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 55/109] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:20 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:20.267591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.276119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64478-4e0d-4bcc-8591-84bf95009b7c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.285005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.314553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b14b5-a42e-4ba6-87d9-4aa0be383b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.315798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b14b5-a42e-4ba6-87d9-4aa0be383b8e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.317284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b14b5-a42e-4ba6-87d9-4aa0be383b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.317772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b14b5-a42e-4ba6-87d9-4aa0be383b8e None admin] PATH_INFO: `/v3/users/4d36cf54b9464e6b8b7da058a8b7eb0e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.333479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b14b5-a42e-4ba6-87d9-4aa0be383b8e None admin] RBAC: Authorizing `identity:get_user(user_id=4d36cf54b9464e6b8b7da058a8b7eb0e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.335458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b14b5-a42e-4ba6-87d9-4aa0be383b8e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.337531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 55/110] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:20 2022] GET /identity/v3/users/4d36cf54b9464e6b8b7da058a8b7eb0e => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:20.339160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab32e-97c0-4452-97ff-84afe6d41ec8 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.339680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab32e-97c0-4452-97ff-84afe6d41ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.340248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab32e-97c0-4452-97ff-84afe6d41ec8 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.341954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 56/111] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:20.342954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab32e-97c0-4452-97ff-84afe6d41ec8 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.397979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.398861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a8b7-8147-41d0-9cb6-ff1be78ad5e8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.444431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.445230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.445514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.445844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.447474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.448934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.450780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 56/112] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:20.451420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.462128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab32e-97c0-4452-97ff-84afe6d41ec8 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.498378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e0b46-3b63-48d5-9edf-99ef3d7d5d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.499360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0b46-3b63-48d5-9edf-99ef3d7d5d3a None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.499651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0b46-3b63-48d5-9edf-99ef3d7d5d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.500501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0b46-3b63-48d5-9edf-99ef3d7d5d3a None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428/users/874eba2718e1486988bc2175440805ce/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.502663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e0b46-3b63-48d5-9edf-99ef3d7d5d3a None admin] RBAC: Authorizing `identity:create_grant(project_id=e9470df72a334ba29e4da06067e1d428, user_id=874eba2718e1486988bc2175440805ce, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.504232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e0b46-3b63-48d5-9edf-99ef3d7d5d3a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.547676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.566710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4f669-f779-4759-811e-3565071cebdd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.579863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 57/113] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:20 2022] PUT /identity/v3/projects/e9470df72a334ba29e4da06067e1d428/users/874eba2718e1486988bc2175440805ce/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:20.582087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876651-a318-4a40-8ccb-b0aa2e36a99f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.582728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876651-a318-4a40-8ccb-b0aa2e36a99f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.583420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876651-a318-4a40-8ccb-b0aa2e36a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.614604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e51c55-dc8b-4c8a-9d19-4472a4bd668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.615840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51c55-dc8b-4c8a-9d19-4472a4bd668f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.616346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51c55-dc8b-4c8a-9d19-4472a4bd668f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.616834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51c55-dc8b-4c8a-9d19-4472a4bd668f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.652094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d9876651-a318-4a40-8ccb-b0aa2e36a99f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:20.653261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d9876651-a318-4a40-8ccb-b0aa2e36a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:20.766376 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e51c55-dc8b-4c8a-9d19-4472a4bd668f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.768204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e51c55-dc8b-4c8a-9d19-4472a4bd668f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:20.777762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 58/114] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:20.779170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876651-a318-4a40-8ccb-b0aa2e36a99f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.835357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.864485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:20.884918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 57/115] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:20.886641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d2ec4-d7d4-4adc-90c2-a79e7a3971b1 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.887311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d2ec4-d7d4-4adc-90c2-a79e7a3971b1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.887760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d2ec4-d7d4-4adc-90c2-a79e7a3971b1 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.889481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 58/116] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:20.890359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d2ec4-d7d4-4adc-90c2-a79e7a3971b1 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:20.904484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876651-a318-4a40-8ccb-b0aa2e36a99f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:20.939742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:20.940419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:20.940718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:20.941034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:20.941810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:20.943321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.004907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d2ec4-d7d4-4adc-90c2-a79e7a3971b1 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.024731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 59/117] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:48:20 2022] POST /identity/v3/projects => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:21.026683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.043504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f25a28-b172-4f9b-bbb4-ad266977c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.044705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25a28-b172-4f9b-bbb4-ad266977c80b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.044865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25a28-b172-4f9b-bbb4-ad266977c80b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.045251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25a28-b172-4f9b-bbb4-ad266977c80b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.058668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f25a28-b172-4f9b-bbb4-ad266977c80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c2f25a28-b172-4f9b-bbb4-ad266977c80b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:21.067452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:21.068949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 59/118] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:21.074999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e79dd-41bb-4a30-87e8-e770fba174a1 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.075929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e79dd-41bb-4a30-87e8-e770fba174a1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.075929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e79dd-41bb-4a30-87e8-e770fba174a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.094927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-359e79dd-41bb-4a30-87e8-e770fba174a1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:21.096319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-359e79dd-41bb-4a30-87e8-e770fba174a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:21.150147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.167806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.183340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986008-699e-44d8-8a87-38e399532dc9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.191595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 60/119] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:21.193074 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e79dd-41bb-4a30-87e8-e770fba174a1 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.236526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6322563-6b23-4130-b35b-7d3d2bad6a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.238154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6322563-6b23-4130-b35b-7d3d2bad6a57 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.238647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6322563-6b23-4130-b35b-7d3d2bad6a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.239085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6322563-6b23-4130-b35b-7d3d2bad6a57 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.240520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6322563-6b23-4130-b35b-7d3d2bad6a57 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.242202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6322563-6b23-4130-b35b-7d3d2bad6a57 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.244774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 60/120] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:21.246533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964e5f-c2fb-4a81-a2f0-50058fb66f99 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.247010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964e5f-c2fb-4a81-a2f0-50058fb66f99 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.247436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964e5f-c2fb-4a81-a2f0-50058fb66f99 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.248998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 61/121] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:21.250378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07964e5f-c2fb-4a81-a2f0-50058fb66f99 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.318779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e79dd-41bb-4a30-87e8-e770fba174a1 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.372595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.373416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.373810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.374197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.375217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:21.375672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.377234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.387302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 61/122] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:21.388247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.391030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07964e5f-c2fb-4a81-a2f0-50058fb66f99 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.432283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8f170-4124-414b-965d-197f421ab47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.432825 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.433589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8f170-4124-414b-965d-197f421ab47c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.433810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8f170-4124-414b-965d-197f421ab47c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.434267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8f170-4124-414b-965d-197f421ab47c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.446047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8f170-4124-414b-965d-197f421ab47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-43c8f170-4124-414b-965d-197f421ab47c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:21.455182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:21.456323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:21.457324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:21.464113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 62/123] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:21.464113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f05b3-6b90-46b6-bef2-0b3a27852f73 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.464113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f05b3-6b90-46b6-bef2-0b3a27852f73 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.464113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f05b3-6b90-46b6-bef2-0b3a27852f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.481177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2d3f05b3-6b90-46b6-bef2-0b3a27852f73 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:21.482586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2d3f05b3-6b90-46b6-bef2-0b3a27852f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:21.495355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.537314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825f11-f388-4021-86ca-a57ba3d589e7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.558345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 63/124] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:21.559230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f05b3-6b90-46b6-bef2-0b3a27852f73 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.580682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.581352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.581804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.582093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.583028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] RBAC: Adding query filter params (role.id=ac4cc313a39d4e44a54f41461198e989, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=4d36cf54b9464e6b8b7da058a8b7eb0e) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:21.583349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.584825 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.590770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 62/125] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/role_assignments?user.id=4d36cf54b9464e6b8b7da058a8b7eb0e&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=ac4cc313a39d4e44a54f41461198e989 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:21.591560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.751268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.757920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b676cb4-dc22-4553-aa29-c1a7929e5b9c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.786592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f05b3-6b90-46b6-bef2-0b3a27852f73 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:21.829509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.830547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.830975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.831384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] PATH_INFO: `/v3/users/980b07a4628a4a1da4fc1c5439c8f483` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.833738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] RBAC: Authorizing `identity:get_user(user_id=980b07a4628a4a1da4fc1c5439c8f483)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.836169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.838894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 64/126] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/users/980b07a4628a4a1da4fc1c5439c8f483 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:21.840274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.845672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:21.846492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:21.846921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:21.847317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:21.848214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:21.848633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:21.851319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:21.868307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:21.873112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 63/127] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:21.874069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:21.967218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fcda1-8281-4bd4-a33e-9a9de8a979f5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.014215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.015178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.016145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.016540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.047527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:22.055562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:22.056558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:22.057376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 65/128] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:22.058020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.128981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4230-d1bb-46f6-a1bc-e9bd274a609e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.146745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:22.190157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010302f-40fc-4255-98fe-c238acf7ea46 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.193132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.193995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.194281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.194559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.196441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.197905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.199945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 64/129] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:21 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:22.209937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.253573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:22.268745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.268745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.268745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.269056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.270317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.271839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.273512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 66/130] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:22 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:22.277986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.352009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e8b4-977b-45d4-b473-35a0cf25e8a5 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.406210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.407475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.407968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.408710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.410336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:22.410876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.412614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.426661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 65/131] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:22.427705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.506406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53587d49-35b5-4db7-b611-466b49b0c553 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.559286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.560536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.561035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.561532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428/users/980b07a4628a4a1da4fc1c5439c8f483/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.564579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9470df72a334ba29e4da06067e1d428, user_id=980b07a4628a4a1da4fc1c5439c8f483, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.566260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.581717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:22.594097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11443-0e6c-4897-b674-656ede573016 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.630188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.631133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.631428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.631711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.632905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.634348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.636276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 66/132] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:22 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:22.636828 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.728817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 67/133] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:22 2022] PUT /identity/v3/projects/e9470df72a334ba29e4da06067e1d428/users/980b07a4628a4a1da4fc1c5439c8f483/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:22.736438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.739988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f4678-1cd0-402c-9cce-00a3b05bd9a0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.746982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:22.778352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.779311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.779598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.779879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.785299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.785299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.785299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 67/134] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:22 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:22.795312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.818841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:22.902022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b9e4-8357-4737-b4ba-5e27eb125ad3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.930550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15803a7a-5bcb-4f8a-bda8-c69c42e731e1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:22.947236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.948130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.948419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.948728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] PATH_INFO: `/v3/projects/c348f82427f44c71aae64898f6b6b21f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.950250 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] RBAC: Authorizing `identity:get_project(project_id=c348f82427f44c71aae64898f6b6b21f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.951747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:22.954144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 68/135] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:22 2022] GET /identity/v3/projects/c348f82427f44c71aae64898f6b6b21f => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:22.960215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:22.991115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a75a-1cc9-4694-9a19-4a002399fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:22.992130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a75a-1cc9-4694-9a19-4a002399fd80 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:22.992435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a75a-1cc9-4694-9a19-4a002399fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:22.992748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a75a-1cc9-4694-9a19-4a002399fd80 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428/users/874eba2718e1486988bc2175440805ce/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:22.995622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a75a-1cc9-4694-9a19-4a002399fd80 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9470df72a334ba29e4da06067e1d428, user_id=874eba2718e1486988bc2175440805ce, role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:22.998003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a75a-1cc9-4694-9a19-4a002399fd80 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:23.070197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:23.080493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc36e06-a691-4dd9-9c13-6d223b38865c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:23.082728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 68/136] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:22 2022] PUT /identity/v3/projects/e9470df72a334ba29e4da06067e1d428/users/874eba2718e1486988bc2175440805ce/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:23.084973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385c70-fbcb-4e93-bd02-7edc039eb0bb None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.085279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385c70-fbcb-4e93-bd02-7edc039eb0bb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.085572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385c70-fbcb-4e93-bd02-7edc039eb0bb None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.087324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 69/137] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:23.094508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4701f2-7a07-4816-a8af-e20f58c8e0b3 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.094795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4701f2-7a07-4816-a8af-e20f58c8e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.095116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4701f2-7a07-4816-a8af-e20f58c8e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.121146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-eb4701f2-7a07-4816-a8af-e20f58c8e0b3 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:23.124104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-eb4701f2-7a07-4816-a8af-e20f58c8e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:23.139611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:23.141087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.141371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.141656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] PATH_INFO: `/v3/projects/c348f82427f44c71aae64898f6b6b21f/users/874eba2718e1486988bc2175440805ce/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.148228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=c348f82427f44c71aae64898f6b6b21f, user_id=874eba2718e1486988bc2175440805ce, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:23.149722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:23.201490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:23.214850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 70/138] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:23.229655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 69/139] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:22 2022] PUT /identity/v3/projects/c348f82427f44c71aae64898f6b6b21f/users/874eba2718e1486988bc2175440805ce/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:23.258295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4701f2-7a07-4816-a8af-e20f58c8e0b3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:23.387910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4701f2-7a07-4816-a8af-e20f58c8e0b3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:23.428495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:23.429611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.430097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.430573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.444512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:23.453703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:23.454625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:23.455409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:23.457713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 71/140] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:23.463879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:23.571474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2562dd-6481-437a-80f7-1911bc9d1cfc None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:23.607707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa3f82-1165-444e-a699-8127df2d6e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:23.608619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa3f82-1165-444e-a699-8127df2d6e7b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.609062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa3f82-1165-444e-a699-8127df2d6e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.609534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa3f82-1165-444e-a699-8127df2d6e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.610429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa3f82-1165-444e-a699-8127df2d6e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:23.610906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa3f82-1165-444e-a699-8127df2d6e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:23.612750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa3f82-1165-444e-a699-8127df2d6e7b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:23.622146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 70/141] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:23.628108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:23.636949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9bd7e-c311-4087-a840-a5a0594028e5 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.637392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9bd7e-c311-4087-a840-a5a0594028e5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.637782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9bd7e-c311-4087-a840-a5a0594028e5 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.639330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 71/142] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:23.648588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251df3e-cb39-4838-b71d-ce028838323f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:23.648880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251df3e-cb39-4838-b71d-ce028838323f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:23.649164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251df3e-cb39-4838-b71d-ce028838323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:23.678497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3251df3e-cb39-4838-b71d-ce028838323f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:23.679735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3251df3e-cb39-4838-b71d-ce028838323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:23.715950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:23.742226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:23.805758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 72/143] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:23.852427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251df3e-cb39-4838-b71d-ce028838323f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:23.865177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7230e9-54e2-4871-b0a6-c438d8a5c6fb None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.011559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.012463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.012757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.013047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.014845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251df3e-cb39-4838-b71d-ce028838323f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.026148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.026148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.026148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 72/144] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:23 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:24.031810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.058922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.060118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.060620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.061093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.063249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.064902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.066918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 73/145] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:24.076248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.103231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:24.206946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317c1c8-4448-441f-a73c-386facedcf83 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.249889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c62450-85c7-4aa3-ba8f-105246379ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.251387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62450-85c7-4aa3-ba8f-105246379ab9 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.251906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62450-85c7-4aa3-ba8f-105246379ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.252382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62450-85c7-4aa3-ba8f-105246379ab9 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.253314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c62450-85c7-4aa3-ba8f-105246379ab9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.255001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c62450-85c7-4aa3-ba8f-105246379ab9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.298451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4d33e-e9ac-4ea1-b489-5a4206d1ca92 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.334671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:24.345087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.345754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.346045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.346331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.387704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 74/146] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:48:24 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:24.389127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadad6-da0c-4c26-95de-6eee9a7ef2e8 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.389421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadad6-da0c-4c26-95de-6eee9a7ef2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.389706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadad6-da0c-4c26-95de-6eee9a7ef2e8 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.391227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 75/147] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:24.396666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52020-5459-4327-9e86-16ff07213019 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.396959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52020-5459-4327-9e86-16ff07213019 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.397245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52020-5459-4327-9e86-16ff07213019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.419303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.420821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.443052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-83c52020-5459-4327-9e86-16ff07213019 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:24.444341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-83c52020-5459-4327-9e86-16ff07213019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:24.557372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:24.561580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 76/148] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:24.606479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c52020-5459-4327-9e86-16ff07213019 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.660512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 73/149] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:24.665754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.691870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:24.801452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c52020-5459-4327-9e86-16ff07213019 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.837717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.838342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ac5c8-4741-4e53-a2ae-b6715b9fb8d1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:24.838481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.838716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.839022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.850657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:24.860600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:24.861490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:24.862527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 77/150] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:24.868010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.933033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:24.934887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:24.935782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:24.936088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:24.936374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:24.938140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:24.939615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:24.941779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 74/151] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:24.949078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:24.977505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8fe6d-f475-496f-994e-63c6a95f8bae None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.013414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.014090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.014377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.014652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.016109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:25.016424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.017812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.026724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 78/152] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:25.031917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:25.142953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706df3e6-ba0c-4bf6-924f-0311365e5068 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.145684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:25.163049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:25.164081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d865f-4323-4910-a736-9d510acb1572 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.178614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.179517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.179803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.180147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] PATH_INFO: `/v3/users/4d36cf54b9464e6b8b7da058a8b7eb0e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.181353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] RBAC: Authorizing `identity:get_user(user_id=4d36cf54b9464e6b8b7da058a8b7eb0e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.182802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.185355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 79/153] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:25 2022] GET /identity/v3/users/4d36cf54b9464e6b8b7da058a8b7eb0e => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:25.191070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:25.213046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.214376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.214924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.215404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.216467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=874eba2718e1486988bc2175440805ce) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:25.216984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.218951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.225826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 75/154] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:24 2022] GET /identity/v3/role_assignments?user.id=874eba2718e1486988bc2175440805ce&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:25.303261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1f22c-89b9-423e-8c75-95119a2bdf72 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.341266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10dfbf-9e0b-445c-969d-aaf5ea44dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.342160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10dfbf-9e0b-445c-969d-aaf5ea44dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.342451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10dfbf-9e0b-445c-969d-aaf5ea44dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.342728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10dfbf-9e0b-445c-969d-aaf5ea44dad6 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.344631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10dfbf-9e0b-445c-969d-aaf5ea44dad6 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.346092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10dfbf-9e0b-445c-969d-aaf5ea44dad6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.347887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 80/155] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:25 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:25.353683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:25.466530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898198-72ae-45cb-8bb9-da4f48d3d6fa None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.504296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.505195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.505478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.505758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428/users/4d36cf54b9464e6b8b7da058a8b7eb0e/roles/ac4cc313a39d4e44a54f41461198e989` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.507818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9470df72a334ba29e4da06067e1d428, user_id=4d36cf54b9464e6b8b7da058a8b7eb0e, role_id=ac4cc313a39d4e44a54f41461198e989)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:25.509289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:25.550479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac741d-c108-419e-8ef6-c3de592edce3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.550794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac741d-c108-419e-8ef6-c3de592edce3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.551089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac741d-c108-419e-8ef6-c3de592edce3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.552536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 81/156] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:25.557500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57229-93ac-4c52-934a-323f96558bbc None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.557846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57229-93ac-4c52-934a-323f96558bbc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.558137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57229-93ac-4c52-934a-323f96558bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.575468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-17c57229-93ac-4c52-934a-323f96558bbc None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:25.581962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-17c57229-93ac-4c52-934a-323f96558bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:25.605415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 76/157] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:25 2022] PUT /identity/v3/projects/e9470df72a334ba29e4da06067e1d428/users/4d36cf54b9464e6b8b7da058a8b7eb0e/roles/ac4cc313a39d4e44a54f41461198e989 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:25.647470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:25.661688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 82/158] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:25.686050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:25.703555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:25.809348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdae6b-e3ef-40bc-a4da-9bc25f6cfda9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:25.861373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:25.862775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:25.863231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:25.863662 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:25.876527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:25.884689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:25.885819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:25.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:25.889280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 77/159] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:25.895633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57229-93ac-4c52-934a-323f96558bbc None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.052095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57229-93ac-4c52-934a-323f96558bbc None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.091578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:26.092167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.092450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.092725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.093473 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:26.093776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:26.095165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:26.106517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 83/160] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:26.112924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.228266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:26.266536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb55e-2916-4dee-a96b-c2845b364b38 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.305736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3ed5d-d98f-4014-80c2-ea58ec7ed0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:26.307029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3ed5d-d98f-4014-80c2-ea58ec7ed0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.307553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3ed5d-d98f-4014-80c2-ea58ec7ed0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.308050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3ed5d-d98f-4014-80c2-ea58ec7ed0b3 None admin] PATH_INFO: `/v3/users/980b07a4628a4a1da4fc1c5439c8f483` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.315548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3ed5d-d98f-4014-80c2-ea58ec7ed0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=980b07a4628a4a1da4fc1c5439c8f483)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:26.317283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3ed5d-d98f-4014-80c2-ea58ec7ed0b3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:26.319180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 78/161] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:26 2022] GET /identity/v3/users/980b07a4628a4a1da4fc1c5439c8f483 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:26.324651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.416242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:26.476548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259acd-8e0d-49d0-8c71-99c6fbbe7515 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.518644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd742ba-aed7-4ffd-b89f-9503d80f31c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:26.519335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd742ba-aed7-4ffd-b89f-9503d80f31c6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.519618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd742ba-aed7-4ffd-b89f-9503d80f31c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.519900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd742ba-aed7-4ffd-b89f-9503d80f31c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.604186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd742ba-aed7-4ffd-b89f-9503d80f31c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:26.606047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd742ba-aed7-4ffd-b89f-9503d80f31c6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:26.668199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:26.700229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff93cea-7194-4acf-97a5-43baf8efdc1c None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.700758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff93cea-7194-4acf-97a5-43baf8efdc1c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.700833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff93cea-7194-4acf-97a5-43baf8efdc1c None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.702290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 79/162] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:26.707231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c26def-ca09-448b-b367-d81018947ed1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.707520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c26def-ca09-448b-b367-d81018947ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.707799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c26def-ca09-448b-b367-d81018947ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.725264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b5c26def-ca09-448b-b367-d81018947ed1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:26.726457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b5c26def-ca09-448b-b367-d81018947ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:26.749180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 84/163] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:26.750623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12b4a-f4df-4bbd-8d20-ffe4f897858b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.750933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12b4a-f4df-4bbd-8d20-ffe4f897858b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.751212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12b4a-f4df-4bbd-8d20-ffe4f897858b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.752713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 85/164] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:26.757301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef12b4a-f4df-4bbd-8d20-ffe4f897858b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.849161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 80/165] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:26.850464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3163755-25cc-424e-b98d-d600454c3e4a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.850756 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3163755-25cc-424e-b98d-d600454c3e4a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.851063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3163755-25cc-424e-b98d-d600454c3e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.884485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c3163755-25cc-424e-b98d-d600454c3e4a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:26.885687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c3163755-25cc-424e-b98d-d600454c3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:26.903514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef12b4a-f4df-4bbd-8d20-ffe4f897858b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:26.968202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:26.969631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:26.969918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:26.970199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:26.972653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:26.974104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:26.976137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 86/166] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:26 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:26.976924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:26.989599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:26.995292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 81/167] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:26.996335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3163755-25cc-424e-b98d-d600454c3e4a None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.000221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.143382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3163755-25cc-424e-b98d-d600454c3e4a None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.181652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.182312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.182653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.182968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.186847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=980b07a4628a4a1da4fc1c5439c8f483) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:27.186847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.186847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.192729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 82/168] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:26 2022] GET /identity/v3/role_assignments?user.id=980b07a4628a4a1da4fc1c5439c8f483&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:27.193547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.224843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48037f64-37bc-4286-bfc1-66553930cd44 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.266179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.310430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1355-6e16-4e3f-b79d-5462a6bc28a6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.318273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.319337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.319766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.320206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.352530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:27.362218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:27.363545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:27.364415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 87/169] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:27.365983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.367282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.367708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.368143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.368251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.392071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:27.400681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:27.401730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:27.402746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:27.409402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 83/170] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:27.415205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.528264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.566458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa8f17-04e6-4773-9d5a-1e9f322520de None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.632836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129902d-a72f-4794-8e9c-a9da64647d15 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.644061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.645082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.645580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.646064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.647043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:27.647557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.649156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.666291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 88/171] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:27.671326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.683170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.706765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.710354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.710354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.710354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.710354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:27.710354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.710694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.726998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 84/172] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:27.735105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.835573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875edc-2d7f-4c98-9323-f65a74fd7a79 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.871311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:27.872196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:27.872482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:27.872762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:27.873988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:27.875515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:27.877835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 89/173] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:27.884247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:27.895718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:27.953753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513680c-5420-48f6-af22-d12d98c6c0cc None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:27.993104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd660d-a695-4ae9-a71c-8a548d9d1341 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.030168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.030878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.031173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.031556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.043528 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.044416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.044701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.044979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] PATH_INFO: `/v3/users/874eba2718e1486988bc2175440805ce` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.046238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] RBAC: Authorizing `identity:get_user(user_id=874eba2718e1486988bc2175440805ce)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.047761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.049722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 85/174] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/users/874eba2718e1486988bc2175440805ce => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:28.054602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.103852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.105299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.118851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:28.200411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:28.285697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27cd38-12ca-4cce-bd6e-4ff83bc04e51 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.353117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 90/175] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:28.368749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.402866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.402866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.402866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.402866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.537150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.538721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.680058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499799be-4a4c-495a-9c12-3ade21db68b9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:28.688351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:28.700293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:28.755557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:28.756440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:28.756732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:28.757010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] PATH_INFO: `/v3/projects/c348f82427f44c71aae64898f6b6b21f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:28.760425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] RBAC: Authorizing `identity:get_project(project_id=c348f82427f44c71aae64898f6b6b21f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:28.761901 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:28.763668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 91/176] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:28 2022] GET /identity/v3/projects/c348f82427f44c71aae64898f6b6b21f => generated 312 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:28.776017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.863311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 86/177] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:28.868351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:28.986386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ab62-ce91-45c0-aeee-316f64020a8f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.069771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939897b0-6c2c-4473-8000-3efbf5277ad9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.077198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151be75-283b-4fb8-91b4-f0627ce91d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.078420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151be75-283b-4fb8-91b4-f0627ce91d3d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.080947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151be75-283b-4fb8-91b4-f0627ce91d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.081199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151be75-283b-4fb8-91b4-f0627ce91d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.083128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151be75-283b-4fb8-91b4-f0627ce91d3d None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=c348f82427f44c71aae64898f6b6b21f, user.id=874eba2718e1486988bc2175440805ce) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:29.083456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151be75-283b-4fb8-91b4-f0627ce91d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.084921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151be75-283b-4fb8-91b4-f0627ce91d3d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.100302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 92/178] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:28 2022] GET /identity/v3/role_assignments?user.id=874eba2718e1486988bc2175440805ce&scope.project.id=c348f82427f44c71aae64898f6b6b21f&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:29.101631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa362c7-45e6-40aa-9bdb-9b777f4e1315 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.101925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa362c7-45e6-40aa-9bdb-9b777f4e1315 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.102210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa362c7-45e6-40aa-9bdb-9b777f4e1315 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.103981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 93/179] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:29.104970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e43e8-4b3a-437f-b48f-b77255961bfd None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.104970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e43e8-4b3a-437f-b48f-b77255961bfd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.105147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e43e8-4b3a-437f-b48f-b77255961bfd None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.106443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 94/180] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:29.112559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df13372-7f09-4ee1-9f56-99e9c298ad92 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.112874 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df13372-7f09-4ee1-9f56-99e9c298ad92 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.113137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df13372-7f09-4ee1-9f56-99e9c298ad92 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.114680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 95/181] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:29.114680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04fe8c-8581-4e10-b52b-264b8d9836b2 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.114680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04fe8c-8581-4e10-b52b-264b8d9836b2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.114680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04fe8c-8581-4e10-b52b-264b8d9836b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.119673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf3d71-cfe0-4579-854e-e462d3a15f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.120590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf3d71-cfe0-4579-854e-e462d3a15f49 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.120874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf3d71-cfe0-4579-854e-e462d3a15f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.121154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf3d71-cfe0-4579-854e-e462d3a15f49 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.123700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf3d71-cfe0-4579-854e-e462d3a15f49 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.125229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf3d71-cfe0-4579-854e-e462d3a15f49 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.127283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 87/182] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:28 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:29.128346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630a8c6-b94d-48cc-b4da-91a5105601c8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.128637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630a8c6-b94d-48cc-b4da-91a5105601c8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.128922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630a8c6-b94d-48cc-b4da-91a5105601c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.144571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ea04fe8c-8581-4e10-b52b-264b8d9836b2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:29.145811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ea04fe8c-8581-4e10-b52b-264b8d9836b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:29.150934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c630a8c6-b94d-48cc-b4da-91a5105601c8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:29.152469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c630a8c6-b94d-48cc-b4da-91a5105601c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:29.183199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.190799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.219066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 96/183] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:29.220970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511b237-e4f1-4df3-8e93-5e7a824abf43 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.221751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511b237-e4f1-4df3-8e93-5e7a824abf43 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.222039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511b237-e4f1-4df3-8e93-5e7a824abf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.244073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2511b237-e4f1-4df3-8e93-5e7a824abf43 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:29.245315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2511b237-e4f1-4df3-8e93-5e7a824abf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:29.246913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 88/184] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:29.248204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630a8c6-b94d-48cc-b4da-91a5105601c8 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.325415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 97/185] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:29.330866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd93d-ec2d-49e8-b7aa-0286b2d92ff3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.330866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd93d-ec2d-49e8-b7aa-0286b2d92ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.330866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd93d-ec2d-49e8-b7aa-0286b2d92ff3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.330866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 98/186] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:29.330866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd93d-ec2d-49e8-b7aa-0286b2d92ff3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.372747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630a8c6-b94d-48cc-b4da-91a5105601c8 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.406704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.407384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.407670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.407953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.408787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] RBAC: Adding query filter params (role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=874eba2718e1486988bc2175440805ce) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:29.409104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.410554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.416312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 89/187] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/role_assignments?user.id=874eba2718e1486988bc2175440805ce&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:29.417305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.434060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.438950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.440321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd93d-ec2d-49e8-b7aa-0286b2d92ff3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.482297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0048e-c94d-4f66-8bbf-0c3ea7951c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.483168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0048e-c94d-4f66-8bbf-0c3ea7951c45 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.483457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0048e-c94d-4f66-8bbf-0c3ea7951c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.483738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0048e-c94d-4f66-8bbf-0c3ea7951c45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.495557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0048e-c94d-4f66-8bbf-0c3ea7951c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-dbc0048e-c94d-4f66-8bbf-0c3ea7951c45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:29.504027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:29.504994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:29.505802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 99/188] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:29.511547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b58d0d-0e6f-4662-97c8-9b5bab633267 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.511857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b58d0d-0e6f-4662-97c8-9b5bab633267 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.512125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b58d0d-0e6f-4662-97c8-9b5bab633267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.529736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-18b58d0d-0e6f-4662-97c8-9b5bab633267 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:29.531044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-18b58d0d-0e6f-4662-97c8-9b5bab633267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:29.537542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9aeef-2611-46a4-98d6-6befcbbf4327 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.579690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.580498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.580780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.581056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.591500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:29.599248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:29.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:29.601187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 90/189] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:29.601854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.655806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 100/190] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:29.656759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b58d0d-0e6f-4662-97c8-9b5bab633267 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.697171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.720269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d786b2f-dd5d-4e3d-b409-b6fcb0de5f46 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.745095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.764623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.764623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.764623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.764623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.765056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b58d0d-0e6f-4662-97c8-9b5bab633267 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.765708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.765708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.765708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 91/191] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:29.765708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.790758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.791458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.791743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.792023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.792775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:29.793080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.794461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.802959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 101/192] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:29.803736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.866125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf718d9-0d6b-4180-bba8-db5a8e0e7ae4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.899581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.900058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c6ef-c5d8-488d-8553-e059eb7d4561 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:29.900242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.900526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.900804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.901557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:29.901862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:29.903272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:29.911122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 92/193] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:29.915764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.920410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:29.936503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:29.937914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:29.938200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:29.938485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:29.948535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:29.956677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:29.957720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 102/194] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:29.958713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:29.973800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.010364 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d08d7-73b5-4005-8390-df30c03c017b None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.042996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.043589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.043871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.044152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.044849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.046759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.060482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58823-955d-4d31-b588-2944bcb5b057 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.093287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.094145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.094427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.094699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] PATH_INFO: `/v3/users/9ec834140fc749008b247e169fe80105` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.107394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] RBAC: Authorizing `identity:get_user(user_id=9ec834140fc749008b247e169fe80105)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.109359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.111041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 103/195] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:29 2022] GET /identity/v3/users/9ec834140fc749008b247e169fe80105 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:30.112061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.151168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 93/196] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:48:29 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:30.151998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.190119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.226395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.229703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970176f3-a7f7-4e52-b21f-c27a3ee643bf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.272088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356f76-601d-42d2-bae8-1b635fc625ba None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.274354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.275830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.276120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.276401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] PATH_INFO: `/v3/users/4d36cf54b9464e6b8b7da058a8b7eb0e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.277677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] RBAC: Authorizing `identity:get_user(user_id=4d36cf54b9464e6b8b7da058a8b7eb0e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.279218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.281663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 104/197] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/users/4d36cf54b9464e6b8b7da058a8b7eb0e => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:30.282314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.315692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.316293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.316578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.316854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.317607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:30.317911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.319363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.329039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 94/198] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:30.334240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.402175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d377bf6-b081-4cd4-981d-8e21b6f732e1 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.448707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.448707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.448707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.448707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.464753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.469375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf179a-c67e-4ad6-b0a6-ccbced4868a9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.499453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.517538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.518543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.519339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.519702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.526103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.527830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.600834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.603405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.672210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 105/199] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:30.673280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.712067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.721952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 95/200] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:30.723228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.756134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:30.787440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9df25-07d1-4d28-8c8c-d8245f4c0372 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.833120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.834245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.834534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.834837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] PATH_INFO: `/v3/users/9ec834140fc749008b247e169fe80105` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.836735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] RBAC: Authorizing `identity:get_user(user_id=9ec834140fc749008b247e169fe80105)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.838953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.841213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 106/201] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/users/9ec834140fc749008b247e169fe80105 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:30.841886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393e68-af8e-463d-a691-8b2d5a52c546 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.842097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.879731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:30.881670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:30.882398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:30.882882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:30.884391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:30.886956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:30.889126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 96/202] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:30.890584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:30.969359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309dec5-0e87-41f3-950a-eb35c80b481e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:30.972755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.007024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.017826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.018700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.019016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.019298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.020075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f80d-e88e-48d3-a453-cfc3203627ed None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.021038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.021930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.023714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 107/203] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:31.024456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.067937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.068933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.069395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.070380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.135942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab06e1-720a-430f-9c66-2a35e70acefc None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.164985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.167238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.172497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.173282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.173679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.174029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.174957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=9ec834140fc749008b247e169fe80105) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:31.175337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.176830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.189510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 108/204] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:31 2022] GET /identity/v3/role_assignments?user.id=9ec834140fc749008b247e169fe80105&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:31.189510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.256888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.349778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.369398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab9dec-0c69-466a-9e5d-628247d8bea8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.377333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 97/205] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:31.384413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.427749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.428847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.429138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.429417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.430459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] RBAC: Adding query filter params (role.id=ac4cc313a39d4e44a54f41461198e989, scope.project.id=e9470df72a334ba29e4da06067e1d428, user.id=4d36cf54b9464e6b8b7da058a8b7eb0e) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:31.430908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.432557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.442879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 109/206] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:31 2022] GET /identity/v3/role_assignments?user.id=4d36cf54b9464e6b8b7da058a8b7eb0e&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=ac4cc313a39d4e44a54f41461198e989 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:31.512881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02bc2a-d248-4407-9660-2f3b9eefd2a8 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.549741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbed8a-2472-4135-b5e3-e967d17976b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.550645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbed8a-2472-4135-b5e3-e967d17976b2 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.550972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbed8a-2472-4135-b5e3-e967d17976b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.551254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbed8a-2472-4135-b5e3-e967d17976b2 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.552624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbed8a-2472-4135-b5e3-e967d17976b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.554146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbed8a-2472-4135-b5e3-e967d17976b2 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.556216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 98/207] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:31 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:31.562633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:31.666397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:31.669462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d3566-e7ee-4e21-8713-9e3bc5aa5aa8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:31.714917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919db69d-9468-45a9-927e-66892e2cf5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:31.715997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db69d-9468-45a9-927e-66892e2cf5ea None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:31.716499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db69d-9468-45a9-927e-66892e2cf5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:31.716982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db69d-9468-45a9-927e-66892e2cf5ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:31.718035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919db69d-9468-45a9-927e-66892e2cf5ea None admin] RBAC: Adding query filter params (role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=9ec834140fc749008b247e169fe80105) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:31.719125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919db69d-9468-45a9-927e-66892e2cf5ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:31.721187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919db69d-9468-45a9-927e-66892e2cf5ea None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:31.731224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 110/208] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:31 2022] GET /identity/v3/role_assignments?user.id=9ec834140fc749008b247e169fe80105&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:32.458622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8447-6bde-4045-8aab-a5464dda36a6 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.459167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8447-6bde-4045-8aab-a5464dda36a6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.459276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8447-6bde-4045-8aab-a5464dda36a6 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.460822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 99/209] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:32.466319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c36d8-c27c-40fc-bdcb-379fac08203d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.466893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c36d8-c27c-40fc-bdcb-379fac08203d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.467380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c36d8-c27c-40fc-bdcb-379fac08203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.484268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ff8c36d8-c27c-40fc-bdcb-379fac08203d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:32.485778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ff8c36d8-c27c-40fc-bdcb-379fac08203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.558547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753de62-eefd-42bd-8d7d-24c5d625454b None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.558733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 111/210] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:32.559006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753de62-eefd-42bd-8d7d-24c5d625454b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.559118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753de62-eefd-42bd-8d7d-24c5d625454b None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.560614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 100/211] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:32.566372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c28fc-c74d-459b-8e9e-8c761704128d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.567228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c28fc-c74d-459b-8e9e-8c761704128d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.567982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c28fc-c74d-459b-8e9e-8c761704128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.585142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753de62-eefd-42bd-8d7d-24c5d625454b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.637854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ea0c28fc-c74d-459b-8e9e-8c761704128d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:32.639620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ea0c28fc-c74d-459b-8e9e-8c761704128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:32.692918 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:32.726136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 112/212] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:32.743096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753de62-eefd-42bd-8d7d-24c5d625454b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.751619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c28fc-c74d-459b-8e9e-8c761704128d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.781327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:32.796933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.798019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.798495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.799011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.813988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:32.826764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:32.827706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:32.828486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:32.831327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 101/213] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:32.836997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.867932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c28fc-c74d-459b-8e9e-8c761704128d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.905459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:32.906612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:32.907137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:32.907636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:32.909000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:32.910652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:32.912492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 113/214] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:32.918297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:32.966800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9cc70-3d4c-4257-b5a8-994fbe7cfed6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:32.988617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.003506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.004563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.005050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.005551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.006613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:33.007142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.008787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.019499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 102/215] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:33.024778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.045191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.053872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c703c-c2aa-480b-83c9-3fd045b8524f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.088955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.090022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.090498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.091034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.091950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.094218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.147522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4bcad-2176-4628-a357-8e3aeab46da1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.182332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61453ee-d2dd-4047-9daa-ad5a4a5a1f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.183234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61453ee-d2dd-4047-9daa-ad5a4a5a1f07 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.183520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61453ee-d2dd-4047-9daa-ad5a4a5a1f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.183791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61453ee-d2dd-4047-9daa-ad5a4a5a1f07 None admin] PATH_INFO: `/v3/users/2175eb1a661140159fb87a3dbc10aeb6` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.198244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61453ee-d2dd-4047-9daa-ad5a4a5a1f07 None admin] RBAC: Authorizing `identity:get_user(user_id=2175eb1a661140159fb87a3dbc10aeb6)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.209656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 114/216] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:48:32 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:33.209818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61453ee-d2dd-4047-9daa-ad5a4a5a1f07 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.209818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 103/217] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/users/2175eb1a661140159fb87a3dbc10aeb6 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:33.213629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.331725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93667-a2e2-46de-bb68-7316220d3f0b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.378222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.379284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.379766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.380277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.399777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c21aef-32a7-44c0-86f3-8d029f6f225a None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.400068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c21aef-32a7-44c0-86f3-8d029f6f225a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.400352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c21aef-32a7-44c0-86f3-8d029f6f225a None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.401984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 104/218] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:33.403155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.408110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266896-86ad-4716-a099-3f2c636a4a71 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.410409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266896-86ad-4716-a099-3f2c636a4a71 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.410724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266896-86ad-4716-a099-3f2c636a4a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.429240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c2266896-86ad-4716-a099-3f2c636a4a71 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:33.431547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c2266896-86ad-4716-a099-3f2c636a4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:33.456668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.458073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.480631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.526641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 105/219] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:33.549412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266896-86ad-4716-a099-3f2c636a4a71 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.582426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 115/220] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:48:33.587667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.648531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.674007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266896-86ad-4716-a099-3f2c636a4a71 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.719145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89c18-0969-4e85-82ff-ddfeed0b2a1f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.720752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.722673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.723176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.723631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.739376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:33.750720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:33.751713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:33.752492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:33.755195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 106/221] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:33.763860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.764935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.765817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.766100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.766374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.768007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.769468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.773239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 116/222] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:33.779429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.835097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.909913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0c0bd-d2de-4373-af32-7e4092af9d6d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.915430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e4dd-d78c-4287-b05a-3a8c50636f41 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:33.927875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:33.947354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5127e-d5a9-43bc-ab25-5f2403a4028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.948224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5127e-d5a9-43bc-ab25-5f2403a4028a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.948554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5127e-d5a9-43bc-ab25-5f2403a4028a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.948900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5127e-d5a9-43bc-ab25-5f2403a4028a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.949746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5127e-d5a9-43bc-ab25-5f2403a4028a None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=2175eb1a661140159fb87a3dbc10aeb6) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:33.950057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5127e-d5a9-43bc-ab25-5f2403a4028a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.951805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5127e-d5a9-43bc-ab25-5f2403a4028a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.957043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:33.958000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 117/223] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/role_assignments?user.id=2175eb1a661140159fb87a3dbc10aeb6&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:33.959365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9742-a00a-44b9-9c6c-0afd49168ee6 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.959651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9742-a00a-44b9-9c6c-0afd49168ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.959927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9742-a00a-44b9-9c6c-0afd49168ee6 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.964027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.964465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.964826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.965508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 118/224] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:33.966042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:33.966421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:33.967152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d501ad1-7192-4254-b7fc-44e1f9431865 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:33.967512 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d501ad1-7192-4254-b7fc-44e1f9431865 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:33.967858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d501ad1-7192-4254-b7fc-44e1f9431865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:33.968690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:33.988708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 107/225] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:33.994352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:33.998061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3d501ad1-7192-4254-b7fc-44e1f9431865 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:33.999341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3d501ad1-7192-4254-b7fc-44e1f9431865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:34.131655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 119/226] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:34.156112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:34.165258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d501ad1-7192-4254-b7fc-44e1f9431865 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.176216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62e55-08e4-41bf-9580-7e099daef4bd None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.241826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.242636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.242944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.243223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] PATH_INFO: `/v3/users/9ec834140fc749008b247e169fe80105` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.245238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] RBAC: Authorizing `identity:get_user(user_id=9ec834140fc749008b247e169fe80105)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.246688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.250740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 108/227] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:33 2022] GET /identity/v3/users/9ec834140fc749008b247e169fe80105 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:34.259474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.361350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d501ad1-7192-4254-b7fc-44e1f9431865 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.387169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:34.443714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.444888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.445417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.445893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.445995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf342a0-fc9c-4999-8c6e-c03c42afdf57 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.479604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:34.485647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.486524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.487153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.487490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:34.488545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:34.489425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:34.490215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 120/228] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:34.491378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.492548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.494535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 109/229] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:34 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:34.495741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.500487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.572133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:34.707658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d44a-28e8-452f-b32f-5ed8fa7ff870 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.775857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49197-8867-4531-9251-848f3a174e68 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:34.792740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.793837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.794322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.794796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.795784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:34.796333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.797983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.817898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 121/230] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:34.823756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:34.828020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:34.828922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:34.829203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:34.829480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/9ec834140fc749008b247e169fe80105/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:34.832367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] RBAC: Authorizing `identity:create_grant(project_id=9b24f237e88b4ae0ae0f2b490dbacaca, user_id=9ec834140fc749008b247e169fe80105, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:34.833829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:34.865483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:34.919664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 110/231] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:34 2022] PUT /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/9ec834140fc749008b247e169fe80105/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:34.950781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbecde-52af-4b92-859c-854476f8be94 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:35.001999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:35.002924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.003215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.003546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] PATH_INFO: `/v3/users/9ec834140fc749008b247e169fe80105` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.004833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] RBAC: Authorizing `identity:get_user(user_id=9ec834140fc749008b247e169fe80105)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:35.006295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:35.008322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 122/232] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:34 2022] GET /identity/v3/users/9ec834140fc749008b247e169fe80105 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:35.013857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:35.122652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:35.135841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c9751-e28c-4ffa-bdda-a04322ff8ddb None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:35.173563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6865c-bf41-48b0-a841-7573d4bfe856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:35.174428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6865c-bf41-48b0-a841-7573d4bfe856 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.174710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6865c-bf41-48b0-a841-7573d4bfe856 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.175043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6865c-bf41-48b0-a841-7573d4bfe856 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.180205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6865c-bf41-48b0-a841-7573d4bfe856 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:35.180205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6865c-bf41-48b0-a841-7573d4bfe856 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:35.180205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 111/233] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:35 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:35.185009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:35.314712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:35.317953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eae7e-f01f-48de-8faf-8a213c7462ee None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:35.361315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5eb3a-3a4b-422f-89f8-bf099c573fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:35.362578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5eb3a-3a4b-422f-89f8-bf099c573fc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.362888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5eb3a-3a4b-422f-89f8-bf099c573fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.363175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5eb3a-3a4b-422f-89f8-bf099c573fc5 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/9ec834140fc749008b247e169fe80105/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.368823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5eb3a-3a4b-422f-89f8-bf099c573fc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b24f237e88b4ae0ae0f2b490dbacaca, user_id=9ec834140fc749008b247e169fe80105, role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:35.370332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5eb3a-3a4b-422f-89f8-bf099c573fc5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:35.523545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 123/234] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:35 2022] PUT /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/9ec834140fc749008b247e169fe80105/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:35.768419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c2b2-e73e-48bc-ab96-3461b8521fc2 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.768958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c2b2-e73e-48bc-ab96-3461b8521fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.768958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c2b2-e73e-48bc-ab96-3461b8521fc2 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.770627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 112/235] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:35.776128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293934-cd10-4997-a5dc-6cd3fe181049 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.776568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293934-cd10-4997-a5dc-6cd3fe181049 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.776658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293934-cd10-4997-a5dc-6cd3fe181049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.781627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69ddec-30e0-4213-88ba-dfeefaa17087 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.781912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69ddec-30e0-4213-88ba-dfeefaa17087 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.782199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69ddec-30e0-4213-88ba-dfeefaa17087 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.783893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 113/236] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:35.789215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f39e-a02d-4849-84a9-42e1dce655f7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:35.789504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f39e-a02d-4849-84a9-42e1dce655f7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:35.789771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f39e-a02d-4849-84a9-42e1dce655f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:35.801414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b3293934-cd10-4997-a5dc-6cd3fe181049 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:35.802627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b3293934-cd10-4997-a5dc-6cd3fe181049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.807353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b275f39e-a02d-4849-84a9-42e1dce655f7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:35.808530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b275f39e-a02d-4849-84a9-42e1dce655f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:35.887952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 114/237] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:35.893299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 124/238] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:35.913479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f39e-a02d-4849-84a9-42e1dce655f7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:35.917105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3293934-cd10-4997-a5dc-6cd3fe181049 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.005710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.018660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.022349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f39e-a02d-4849-84a9-42e1dce655f7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.033159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3293934-cd10-4997-a5dc-6cd3fe181049 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.057141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.060218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.060218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.060218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.060218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.061081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.062762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 115/239] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:36.068024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.086700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.087553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.087835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.088112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.105524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:36.120954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:36.121897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:36.123167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 125/240] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:36.129919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.186466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929905-b1b5-4c24-b550-178a38b4ffcb None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.223142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.223846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.224140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.224422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.225136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.226581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.288714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609c769-ba1f-4588-9464-4e9243e3a62b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.313603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 116/241] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:48:36 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:48:36.342750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ba09-97ed-4f05-ab6d-8c7086a172be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.343892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ba09-97ed-4f05-ab6d-8c7086a172be None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.344430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ba09-97ed-4f05-ab6d-8c7086a172be None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.344908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ba09-97ed-4f05-ab6d-8c7086a172be None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.345902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ba09-97ed-4f05-ab6d-8c7086a172be None admin] RBAC: Adding query filter params (name=reader) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:36.360367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ba09-97ed-4f05-ab6d-8c7086a172be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.362371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ba09-97ed-4f05-ab6d-8c7086a172be None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.380019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 126/242] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:36.388299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.407759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.541790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9259e1-b36d-4c11-9e61-bb30cdc37053 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.546750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb0829-e043-4e69-b1cb-a69bcf4cca8b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.547059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb0829-e043-4e69-b1cb-a69bcf4cca8b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.547343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb0829-e043-4e69-b1cb-a69bcf4cca8b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.548742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 127/243] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:36.558988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb120202-48dd-4061-b786-eb33987200ef None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.559709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb120202-48dd-4061-b786-eb33987200ef None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.560186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb120202-48dd-4061-b786-eb33987200ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.588663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-eb120202-48dd-4061-b786-eb33987200ef None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:36.589866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-eb120202-48dd-4061-b786-eb33987200ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:36.597909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.598611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.599587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.599883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.600163 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] PATH_INFO: `/v3/users/2ab6778c7e294eb3972226ebb1a55acf` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.615603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab6778c7e294eb3972226ebb1a55acf)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.619019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.619019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 117/244] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:36 2022] GET /identity/v3/users/2ab6778c7e294eb3972226ebb1a55acf => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:36.628193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.673873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 128/245] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:36.705019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb120202-48dd-4061-b786-eb33987200ef None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.711013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.750852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b7c24-6535-419b-9d54-decd6776c0b4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.802113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.802711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.803014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.803301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.845734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb120202-48dd-4061-b786-eb33987200ef None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:36.876588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:36.878087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:36.884678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:36.885843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:36.886419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:36.886908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:36.899860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:36.908976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:36.909859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:36.910643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:36.913877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 129/246] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:36.920574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:36.925028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.961661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:36.998690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 118/247] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:37.006369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.067876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6638c-2944-4181-8280-f7404665a25d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.113242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.114029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.114411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.114703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.115545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:37.115916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.117460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.123563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52d236-aba7-4689-ab2f-71224c51712b None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.129707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 130/248] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:37.136389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.161898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.162769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.163141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.163440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.164662 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.166120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.168419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 119/249] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:37 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:37.176649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.210180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:37.217666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:37.250944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb35ec-2e01-4170-80bb-c3016d1b404f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.286436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84c479-daa5-4954-b962-ff162e86afeb None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.289249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.290349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.290911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.291383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] PATH_INFO: `/v3/users/2175eb1a661140159fb87a3dbc10aeb6` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.292810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=2175eb1a661140159fb87a3dbc10aeb6)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.295613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.302767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 131/250] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:37 2022] GET /identity/v3/users/2175eb1a661140159fb87a3dbc10aeb6 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:37.304497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.325414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.325998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.326554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.326676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.327553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] RBAC: Adding query filter params (role.id=ac4cc313a39d4e44a54f41461198e989, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=2ab6778c7e294eb3972226ebb1a55acf) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:37.327924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.329396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.335440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 120/251] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:37 2022] GET /identity/v3/role_assignments?user.id=2ab6778c7e294eb3972226ebb1a55acf&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=ac4cc313a39d4e44a54f41461198e989 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:37.444824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaffc5-3ee0-43b1-8944-809428606bd8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.490703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:37.502970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38df8a-2497-4f1d-8f36-78739b0b4545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.503867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38df8a-2497-4f1d-8f36-78739b0b4545 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.504170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38df8a-2497-4f1d-8f36-78739b0b4545 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.504434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38df8a-2497-4f1d-8f36-78739b0b4545 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.505652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38df8a-2497-4f1d-8f36-78739b0b4545 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.507152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38df8a-2497-4f1d-8f36-78739b0b4545 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.509090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 132/252] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:37 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:37.515031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.551076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977960cf-fa06-487c-80a8-7d5632500174 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.551364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977960cf-fa06-487c-80a8-7d5632500174 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.551645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977960cf-fa06-487c-80a8-7d5632500174 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.553028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 133/253] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:37.568600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22274728-71eb-4b5b-be15-c702bc156a39 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.568900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22274728-71eb-4b5b-be15-c702bc156a39 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.569171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22274728-71eb-4b5b-be15-c702bc156a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.622287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-22274728-71eb-4b5b-be15-c702bc156a39 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:37.623438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-22274728-71eb-4b5b-be15-c702bc156a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:37.673465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:37.679592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805b18c-c744-4233-bdb3-e49965c46300 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.721488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.722778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.725316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:37.725808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/2175eb1a661140159fb87a3dbc10aeb6/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:37.734458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b24f237e88b4ae0ae0f2b490dbacaca, user_id=2175eb1a661140159fb87a3dbc10aeb6, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:37.736214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:37.772406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 134/254] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:37.818792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22274728-71eb-4b5b-be15-c702bc156a39 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:37.835628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 121/255] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:37 2022] PUT /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/2175eb1a661140159fb87a3dbc10aeb6/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:37.949043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22274728-71eb-4b5b-be15-c702bc156a39 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:37.992620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:37.998760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:37.999636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:37.999938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.000194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.019563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:38.027924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:38.028894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:38.030809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 135/256] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:38.035505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.164102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cd71d-bc41-4c65-a66f-7ee7fb36c5b7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:38.202897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:38.203899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.204378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.204861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.205811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:38.206308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:38.207920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:38.217451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 122/257] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:38.227240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.362282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08666f40-b4e3-4714-820e-43c5cc55e936 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:38.412518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8cd07-4e87-4123-b8be-9e967634c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:38.413401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cd07-4e87-4123-b8be-9e967634c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.413692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cd07-4e87-4123-b8be-9e967634c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.414035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cd07-4e87-4123-b8be-9e967634c5a1 None admin] PATH_INFO: `/v3/users/9ec834140fc749008b247e169fe80105` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.415325 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8cd07-4e87-4123-b8be-9e967634c5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=9ec834140fc749008b247e169fe80105)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:38.416834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8cd07-4e87-4123-b8be-9e967634c5a1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:38.418471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 136/258] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:38 2022] GET /identity/v3/users/9ec834140fc749008b247e169fe80105 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:38.424152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.467318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:38.567491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b883-0470-4f2b-ab44-e441995393c1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:38.612906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b8b5-368b-4c78-96d1-58665d3dc26f None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.613529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b8b5-368b-4c78-96d1-58665d3dc26f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.613633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:38.614140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b8b5-368b-4c78-96d1-58665d3dc26f None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.614241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.614489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.614766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.616336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 137/259] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:38.624902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f380-a651-4faf-bc3a-77d0c91afbc9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:38.625199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f380-a651-4faf-bc3a-77d0c91afbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:38.625481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f380-a651-4faf-bc3a-77d0c91afbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:38.663726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6039f380-a651-4faf-bc3a-77d0c91afbc9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:38.663726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6039f380-a651-4faf-bc3a-77d0c91afbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:38.726010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:38.727415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:38.792396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:38.794407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:38.815525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 138/260] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:38.849672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f380-a651-4faf-bc3a-77d0c91afbc9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:38.973659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 123/261] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:38.979982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.042419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f380-a651-4faf-bc3a-77d0c91afbc9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.104487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.105638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.106170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.106639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.131852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:39.150130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:39.151104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:39.151990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:39.156226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 139/262] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:39.161692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.187291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da103bf5-7bf5-42a7-b7cf-dd6835909cd5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.211445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:39.227218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.243256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.243256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.243256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.243256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.243256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.243256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 124/263] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:38 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:39.248198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.270476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:39.391211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375918-5ec4-41db-9e24-f2c89efa1379 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.477608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7887858-6a14-4653-935c-c6330bcc91ae None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.484217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.484915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.485205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.485487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.486316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:39.486905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.488383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.506280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 140/264] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:39.515054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.533258 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.534412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.534764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.536166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.536166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=9ec834140fc749008b247e169fe80105) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:39.536422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.537869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.545535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 125/265] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:39 2022] GET /identity/v3/role_assignments?user.id=9ec834140fc749008b247e169fe80105&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:39.687823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b6aa8-29e9-418f-bbb5-378c5420a4f3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.708980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:39.739085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f8d3-95fc-47af-89dc-0a36c0ff60f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.739978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f8d3-95fc-47af-89dc-0a36c0ff60f6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.740313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f8d3-95fc-47af-89dc-0a36c0ff60f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.740594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f8d3-95fc-47af-89dc-0a36c0ff60f6 None admin] PATH_INFO: `/v3/users/9ec834140fc749008b247e169fe80105` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.741801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f8d3-95fc-47af-89dc-0a36c0ff60f6 None admin] RBAC: Authorizing `identity:get_user(user_id=9ec834140fc749008b247e169fe80105)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:39.743275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f8d3-95fc-47af-89dc-0a36c0ff60f6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:39.744912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 141/266] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:39 2022] GET /identity/v3/users/9ec834140fc749008b247e169fe80105 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:39.751124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:39.847312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:39.901475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2d4a-27ee-460b-b02e-e47e072f7ea6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:39.903035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9ae0-e7de-44ba-a49c-1490dc666a3a None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.903333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9ae0-e7de-44ba-a49c-1490dc666a3a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.903621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9ae0-e7de-44ba-a49c-1490dc666a3a None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.905777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 142/267] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:39.911721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8679-1d51-47ee-a508-11a7699fb924 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.912017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8679-1d51-47ee-a508-11a7699fb924 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.912301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8679-1d51-47ee-a508-11a7699fb924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.944859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:39.945520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:39.945802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:39.946085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:39.951849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e16f8679-1d51-47ee-a508-11a7699fb924 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:39.953632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e16f8679-1d51-47ee-a508-11a7699fb924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.022357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.024002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.084766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.120655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 143/268] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:40.134781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 126/269] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:40.141217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8679-1d51-47ee-a508-11a7699fb924 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.167038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.267644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8679-1d51-47ee-a508-11a7699fb924 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.277281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.285423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30255-fda2-4fda-a51b-96f8a31ba1ce None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.303365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32de2b0-135d-415e-b7d8-3cf758167550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.304243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32de2b0-135d-415e-b7d8-3cf758167550 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.304510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32de2b0-135d-415e-b7d8-3cf758167550 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.304789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32de2b0-135d-415e-b7d8-3cf758167550 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.305984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32de2b0-135d-415e-b7d8-3cf758167550 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.307467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32de2b0-135d-415e-b7d8-3cf758167550 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.309321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 144/270] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:40.313956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934fc9-e921-4662-8039-061593cc18c1 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.313956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934fc9-e921-4662-8039-061593cc18c1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.313956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934fc9-e921-4662-8039-061593cc18c1 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.314226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 145/271] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:40.319593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cebe-5069-4a55-ab7a-035e02662d79 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.319886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cebe-5069-4a55-ab7a-035e02662d79 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.320173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cebe-5069-4a55-ab7a-035e02662d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.330674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.331923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.332410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.332886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.337635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-74f6cebe-5069-4a55-ab7a-035e02662d79 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:40.338863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-74f6cebe-5069-4a55-ab7a-035e02662d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.344844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:40.353374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:40.354282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:40.355091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:40.357655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 127/272] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:40.359274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.414354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 146/273] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:40.415185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6cebe-5069-4a55-ab7a-035e02662d79 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.455232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.468297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31598593-64ef-4b28-86db-11178bbc51cc None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.506371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.507512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.508033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.508514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.509630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] RBAC: Adding query filter params (role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=9ec834140fc749008b247e169fe80105) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:40.510208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.512095 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.518910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 128/274] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/role_assignments?user.id=9ec834140fc749008b247e169fe80105&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:40.527994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.546573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6cebe-5069-4a55-ab7a-035e02662d79 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.559820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.585134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581b917-c973-4735-a0eb-bc56534e08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.585825 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b917-c973-4735-a0eb-bc56534e08ed None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.586111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b917-c973-4735-a0eb-bc56534e08ed None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.586391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b917-c973-4735-a0eb-bc56534e08ed None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.587216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b917-c973-4735-a0eb-bc56534e08ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:40.587530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b917-c973-4735-a0eb-bc56534e08ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.588994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b917-c973-4735-a0eb-bc56534e08ed None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.598519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 147/275] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:40.604241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3656be5-03a6-476c-a074-a8d16108d1b5 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.604535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3656be5-03a6-476c-a074-a8d16108d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.604823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3656be5-03a6-476c-a074-a8d16108d1b5 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.606275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 148/276] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:40.612201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3656be5-03a6-476c-a074-a8d16108d1b5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.639226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.664664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea0665-78d7-4826-bcff-9a31f9fed5ff None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.704464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecea449-987a-40c7-93f3-0aa1157f4cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.704832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea449-987a-40c7-93f3-0aa1157f4cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.705103 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea449-987a-40c7-93f3-0aa1157f4cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.705387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea449-987a-40c7-93f3-0aa1157f4cc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.706683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecea449-987a-40c7-93f3-0aa1157f4cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.708156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecea449-987a-40c7-93f3-0aa1157f4cc5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.714609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 129/277] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:40.714609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984e70-ebcd-4491-a0a8-e7e81bd71d72 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.714609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984e70-ebcd-4491-a0a8-e7e81bd71d72 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.714609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984e70-ebcd-4491-a0a8-e7e81bd71d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.726076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3656be5-03a6-476c-a074-a8d16108d1b5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.730730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b7984e70-ebcd-4491-a0a8-e7e81bd71d72 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:40.731960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b7984e70-ebcd-4491-a0a8-e7e81bd71d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:40.767446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615ce3d-5e60-43f8-878f-f70dbe56780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.768325 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615ce3d-5e60-43f8-878f-f70dbe56780c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.769048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615ce3d-5e60-43f8-878f-f70dbe56780c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.769048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615ce3d-5e60-43f8-878f-f70dbe56780c None admin] PATH_INFO: `/v3/users/8dd194e246ae41709ef5136bb7892444` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.783784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615ce3d-5e60-43f8-878f-f70dbe56780c None admin] RBAC: Authorizing `identity:get_user(user_id=8dd194e246ae41709ef5136bb7892444)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.785264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615ce3d-5e60-43f8-878f-f70dbe56780c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.787301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 149/278] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/users/8dd194e246ae41709ef5136bb7892444 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:40.788554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803876-5c0e-4278-99ad-746170b0edf8 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.788840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803876-5c0e-4278-99ad-746170b0edf8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.789123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803876-5c0e-4278-99ad-746170b0edf8 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.790518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 150/279] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:40.791078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803876-5c0e-4278-99ad-746170b0edf8 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.805968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 130/280] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:40.807264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7984e70-ebcd-4491-a0a8-e7e81bd71d72 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:40.820716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.882493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:40.898478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803876-5c0e-4278-99ad-746170b0edf8 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.904426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7984e70-ebcd-4491-a0a8-e7e81bd71d72 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:40.932635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.933322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.933608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.933882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.934578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.936084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.938839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959864d1-0f32-462a-b9d2-356de1f55340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:40.939505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959864d1-0f32-462a-b9d2-356de1f55340 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.939789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959864d1-0f32-462a-b9d2-356de1f55340 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.940065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959864d1-0f32-462a-b9d2-356de1f55340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.940926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959864d1-0f32-462a-b9d2-356de1f55340 None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, user.id=8dd194e246ae41709ef5136bb7892444, scope.system=all) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:40.941240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959864d1-0f32-462a-b9d2-356de1f55340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:40.942663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959864d1-0f32-462a-b9d2-356de1f55340 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:40.947943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 131/281] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 22 08:48:40 2022] GET /identity/v3/role_assignments?user.id=8dd194e246ae41709ef5136bb7892444&scope.system=all&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:40.948916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520b539-259e-4a77-87eb-cf1b732bdca8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:40.949201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520b539-259e-4a77-87eb-cf1b732bdca8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:40.949535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520b539-259e-4a77-87eb-cf1b732bdca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:40.966946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f520b539-259e-4a77-87eb-cf1b732bdca8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:40.968734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f520b539-259e-4a77-87eb-cf1b732bdca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:41.022101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 151/282] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:41.023099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.063502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 132/283] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:41.088542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520b539-259e-4a77-87eb-cf1b732bdca8 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.166564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.176461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.190307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd476ef-7fbc-41d1-a7e4-eb264f5d76ec None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.216868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520b539-259e-4a77-87eb-cf1b732bdca8 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.235887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.236973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.237253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.237522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.250293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:41.259236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:41.260134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:41.260932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 152/284] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:41.266575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.267085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.267409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.267783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.268074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.281596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:41.289044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:41.289972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:41.290793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 133/285] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:41.296030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.396265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0a38-b229-461e-8761-c7726c3f5951 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.445735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c46f6-375f-43f9-8984-c30bc8d27436 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.451729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.453212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.453691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.454643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.455619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:41.456575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.458850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.470721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 153/286] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:41.476258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.485876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.491879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.503458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.504453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.504985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.505478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.506530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] RBAC: Adding query filter params (name=member) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:41.507106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.510446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.533711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 134/287] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:41.539099 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.663364 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426649-a3a1-4640-b53d-49da84bba801 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.693851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefaa50-6218-40aa-b212-3ee5fbdabe1e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.705661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.707453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.707956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.708424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] PATH_INFO: `/v3/users/2175eb1a661140159fb87a3dbc10aeb6` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.709858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=2175eb1a661140159fb87a3dbc10aeb6)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.712000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.713870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 135/288] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/users/2175eb1a661140159fb87a3dbc10aeb6 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:41.719276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.765351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.767227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.767862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.769349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] PATH_INFO: `/v3/users/2ab6778c7e294eb3972226ebb1a55acf` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.772010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab6778c7e294eb3972226ebb1a55acf)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:41.773810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:41.777935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 154/289] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/users/2ab6778c7e294eb3972226ebb1a55acf => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:41.782309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:41.829594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.896872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a5275-84af-4edc-911b-e57bb9375cf7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:41.915808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:41.938474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:41.939152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:41.939440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:41.939719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:41.971592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e1c9-5f31-4825-a592-672c61e9ed66 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.017110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.017977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.018260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.018536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.019823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.021281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.025631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 155/290] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:42.028443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.084576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.086057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.174409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:42.212882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc20bcf-b764-4f6f-a041-e1b6dd701716 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.247675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 136/291] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:42.253556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.293251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2c86a-63dd-41dd-8094-a3748e91d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.294148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c86a-63dd-41dd-8094-a3748e91d2bf None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.294430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c86a-63dd-41dd-8094-a3748e91d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.294713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c86a-63dd-41dd-8094-a3748e91d2bf None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/2ab6778c7e294eb3972226ebb1a55acf/roles/ac4cc313a39d4e44a54f41461198e989` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.299251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2c86a-63dd-41dd-8094-a3748e91d2bf None admin] RBAC: Authorizing `identity:create_grant(project_id=9b24f237e88b4ae0ae0f2b490dbacaca, user_id=2ab6778c7e294eb3972226ebb1a55acf, role_id=ac4cc313a39d4e44a54f41461198e989)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.300708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2c86a-63dd-41dd-8094-a3748e91d2bf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.361087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832427-dc29-4c15-9cc9-cc049384a218 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.396029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.396886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.397191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.397489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.398763 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.400218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.402254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 137/292] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:42 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:42.414057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 156/293] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:48:42 2022] PUT /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/users/2ab6778c7e294eb3972226ebb1a55acf/roles/ac4cc313a39d4e44a54f41461198e989 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:42.414315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:42.415215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:42.477144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:42.556787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280439a-28e9-4ea4-a9b7-d19a97cb0b45 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:42.594541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c89b17-b425-41b8-9399-d812930a315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:42.595307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89b17-b425-41b8-9399-d812930a315f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:42.595598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89b17-b425-41b8-9399-d812930a315f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:42.595881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89b17-b425-41b8-9399-d812930a315f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:42.596730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c89b17-b425-41b8-9399-d812930a315f None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=2175eb1a661140159fb87a3dbc10aeb6) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:42.597058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c89b17-b425-41b8-9399-d812930a315f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:42.598484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c89b17-b425-41b8-9399-d812930a315f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:42.604936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 138/294] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:42 2022] GET /identity/v3/role_assignments?user.id=2175eb1a661140159fb87a3dbc10aeb6&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:43.188951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee959fe-5dd2-42af-8e8d-db26227729eb None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.189485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee959fe-5dd2-42af-8e8d-db26227729eb None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.189911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee959fe-5dd2-42af-8e8d-db26227729eb None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.191494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 157/295] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:43.197475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f966b-1034-42b9-a243-236aad855cc7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.198331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f966b-1034-42b9-a243-236aad855cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.198816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f966b-1034-42b9-a243-236aad855cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.216069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-5b4f966b-1034-42b9-a243-236aad855cc7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:43.218142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5b4f966b-1034-42b9-a243-236aad855cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:43.302924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 139/296] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:43.320302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee959fe-5dd2-42af-8e8d-db26227729eb None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.429052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee959fe-5dd2-42af-8e8d-db26227729eb None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.464035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f1c8b-1b03-4b6d-93d4-836edfd86315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.464752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f1c8b-1b03-4b6d-93d4-836edfd86315 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.465038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f1c8b-1b03-4b6d-93d4-836edfd86315 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.465315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f1c8b-1b03-4b6d-93d4-836edfd86315 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.476421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f1c8b-1b03-4b6d-93d4-836edfd86315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-a38f1c8b-1b03-4b6d-93d4-836edfd86315 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:43.484188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:43.485086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:43.485880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:43.490741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 158/297] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:43.492140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f966b-1034-42b9-a243-236aad855cc7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.516739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:43.535124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39f0d-e065-45a9-89e6-9ec0012d7b27 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.535409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39f0d-e065-45a9-89e6-9ec0012d7b27 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.535694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39f0d-e065-45a9-89e6-9ec0012d7b27 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.537348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 159/298] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:43.544264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33c0a-aa97-4e70-b0db-1ffc72d6bbfb None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.544663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33c0a-aa97-4e70-b0db-1ffc72d6bbfb None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.545044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33c0a-aa97-4e70-b0db-1ffc72d6bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.566035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-04f33c0a-aa97-4e70-b0db-1ffc72d6bbfb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:43.567586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-04f33c0a-aa97-4e70-b0db-1ffc72d6bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:43.605264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f966b-1034-42b9-a243-236aad855cc7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.642412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.643353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.643488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:43.643635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.643914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.644733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:43.645043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:43.646414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:43.655827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 140/299] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:43.658952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 160/300] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:43.661728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950675ab-59e8-46fc-aa34-4240b3084292 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.661728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950675ab-59e8-46fc-aa34-4240b3084292 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.661728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950675ab-59e8-46fc-aa34-4240b3084292 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.661930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.662766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 161/301] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:43.667942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a855a-fe8f-4839-84e2-41ffdc211313 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.668384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a855a-fe8f-4839-84e2-41ffdc211313 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.668836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a855a-fe8f-4839-84e2-41ffdc211313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.689375 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-212a855a-fe8f-4839-84e2-41ffdc211313 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:43.691417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-212a855a-fe8f-4839-84e2-41ffdc211313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:43.758669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:43.770878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 162/302] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:43.770878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a855a-fe8f-4839-84e2-41ffdc211313 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.781509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83c068-499d-48da-bb82-b8a1f38ac2c9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.820307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.821182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.821467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.821747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] PATH_INFO: `/v3/users/8dd194e246ae41709ef5136bb7892444` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.822982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] RBAC: Authorizing `identity:get_user(user_id=8dd194e246ae41709ef5136bb7892444)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:43.824417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:43.826036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 141/303] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/users/8dd194e246ae41709ef5136bb7892444 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:43.826793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.880750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a855a-fe8f-4839-84e2-41ffdc211313 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.902575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:43.919663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.920451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.920763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.921094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.929125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e88aa-d3f8-457d-ac33-f8389eb5acdb None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:43.931811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:43.940604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:43.941511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:43.942309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 163/304] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:43.943067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.970189 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:43.971270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:43.971767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:43.972050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:43.973213 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:43.974631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:43.976272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 142/305] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:43.977021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:43.998541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:44.052927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544de63b-7237-4a1b-af87-3a9c53470010 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.081832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83539d51-1b70-4889-8fc9-ad2a1188f96f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.088639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.089912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.090204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.090489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] PATH_INFO: `/v3/system/users/8dd194e246ae41709ef5136bb7892444/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.092721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8dd194e246ae41709ef5136bb7892444, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.094116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.116362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.117027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.117318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.117597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.118349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:44.118659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.120094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.128863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 143/306] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:44.133653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.185528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 164/307] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jun 22 08:48:43 2022] PUT /identity/v3/system/users/8dd194e246ae41709ef5136bb7892444/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:44.187795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.227410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:44.248672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:44.254011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652c3e-84e7-4dff-a744-fbe798b532c7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.297032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.298086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.298224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.298493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] PATH_INFO: `/v3/groups` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.299352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.300959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.326966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f51f9-c7ff-4a41-a131-341e4d3661fd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.362722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34adbf8-f63f-4d95-b1a3-60f3fd94e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.363626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34adbf8-f63f-4d95-b1a3-60f3fd94e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.363910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34adbf8-f63f-4d95-b1a3-60f3fd94e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.364183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34adbf8-f63f-4d95-b1a3-60f3fd94e0c5 None admin] PATH_INFO: `/v3/users/4b73c6571ac14dffba24433ed0fe92e9` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.378689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34adbf8-f63f-4d95-b1a3-60f3fd94e0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=4b73c6571ac14dffba24433ed0fe92e9)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.380169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34adbf8-f63f-4d95-b1a3-60f3fd94e0c5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.381032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 144/308] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jun 22 08:48:44 2022] POST /identity/v3/groups => generated 229 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:44.382106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 165/309] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:44 2022] GET /identity/v3/users/4b73c6571ac14dffba24433ed0fe92e9 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:44.388420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.508487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d71d6f-0a56-42df-b5f2-399d2dfda8db None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.547435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d47b3-7e6f-4895-bf1a-daada62236c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.548451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d47b3-7e6f-4895-bf1a-daada62236c5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.548899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d47b3-7e6f-4895-bf1a-daada62236c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.549335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d47b3-7e6f-4895-bf1a-daada62236c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.550375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d47b3-7e6f-4895-bf1a-daada62236c5 None admin] RBAC: Adding query filter params (role.id=ac4cc313a39d4e44a54f41461198e989, user.id=4b73c6571ac14dffba24433ed0fe92e9, scope.system=all) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:44.550881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d47b3-7e6f-4895-bf1a-daada62236c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:44.552538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d47b3-7e6f-4895-bf1a-daada62236c5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:44.559322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 145/310] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 22 08:48:44 2022] GET /identity/v3/role_assignments?user.id=4b73c6571ac14dffba24433ed0fe92e9&scope.system=all&role.id=ac4cc313a39d4e44a54f41461198e989 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:44.708903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336c8d-1262-4e45-ba57-62404cc8781c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.709201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336c8d-1262-4e45-ba57-62404cc8781c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.709472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336c8d-1262-4e45-ba57-62404cc8781c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.711161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 166/311] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:44.716510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730387d6-1fb6-4ec0-a277-f0e0354936a4 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.716814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730387d6-1fb6-4ec0-a277-f0e0354936a4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.717102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730387d6-1fb6-4ec0-a277-f0e0354936a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.729727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:44.735994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-730387d6-1fb6-4ec0-a277-f0e0354936a4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:44.737703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-730387d6-1fb6-4ec0-a277-f0e0354936a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:44.812303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 146/312] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:44.835429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336c8d-1262-4e45-ba57-62404cc8781c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:44.949008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336c8d-1262-4e45-ba57-62404cc8781c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:44.950541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:44.984869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:44.985591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:44.986043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:44.986273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:44.997490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:45.005364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:45.006294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:45.007351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:45.010943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 167/313] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:45.012615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730387d6-1fb6-4ec0-a277-f0e0354936a4 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.114615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730387d6-1fb6-4ec0-a277-f0e0354936a4 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.149241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.149962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.150247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.150520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.151300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:45.151593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.154010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.160820 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:45.162655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 147/314] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:45.168598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.277471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca002-569e-41b9-81d5-de825b900e44 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.311045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.312437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.312715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.312983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] PATH_INFO: `/v3/users/2ab6778c7e294eb3972226ebb1a55acf` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.314220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab6778c7e294eb3972226ebb1a55acf)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.315791 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.317454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 168/315] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/users/2ab6778c7e294eb3972226ebb1a55acf => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:45.322862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.427601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074834-d744-48fc-849c-cf3568494262 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.462444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.463119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.463403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.463679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.531148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:45.532247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.533891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.639663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 148/316] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:45.645178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.676491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:45.748086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf70593-2a7a-4827-862a-9d14e7f26b78 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.783412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb4377-77ff-4a8b-bc40-88b1110c6245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.784238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb4377-77ff-4a8b-bc40-88b1110c6245 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.784518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb4377-77ff-4a8b-bc40-88b1110c6245 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.784792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb4377-77ff-4a8b-bc40-88b1110c6245 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.785957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb4377-77ff-4a8b-bc40-88b1110c6245 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.787418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb4377-77ff-4a8b-bc40-88b1110c6245 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.789386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 169/317] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:45.795170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:45.892222 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:45.896139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639970a6-e54b-4698-bb4e-b29fbbed4803 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:45.931263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec0bfc-7d06-4250-b1c8-2251a4a8b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:45.931913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec0bfc-7d06-4250-b1c8-2251a4a8b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:45.932194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec0bfc-7d06-4250-b1c8-2251a4a8b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:45.932465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec0bfc-7d06-4250-b1c8-2251a4a8b2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:45.933301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec0bfc-7d06-4250-b1c8-2251a4a8b2e4 None admin] RBAC: Adding query filter params (role.id=ac4cc313a39d4e44a54f41461198e989, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca, user.id=2ab6778c7e294eb3972226ebb1a55acf) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:45.933607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec0bfc-7d06-4250-b1c8-2251a4a8b2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:45.935061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec0bfc-7d06-4250-b1c8-2251a4a8b2e4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:45.941766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 149/318] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:48:45 2022] GET /identity/v3/role_assignments?user.id=2ab6778c7e294eb3972226ebb1a55acf&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=ac4cc313a39d4e44a54f41461198e989 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:46.335794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154158ef-8d0f-4bfb-878d-d0b9fac0ea0f None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.336169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154158ef-8d0f-4bfb-878d-d0b9fac0ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.336372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154158ef-8d0f-4bfb-878d-d0b9fac0ea0f None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.337877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 170/319] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:46.343458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5584f05-ecf4-4dfe-a0a8-531ed5e28302 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.343903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5584f05-ecf4-4dfe-a0a8-531ed5e28302 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.344062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5584f05-ecf4-4dfe-a0a8-531ed5e28302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.363038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d5584f05-ecf4-4dfe-a0a8-531ed5e28302 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:46.364281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d5584f05-ecf4-4dfe-a0a8-531ed5e28302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:46.433075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 150/320] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:46.456513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154158ef-8d0f-4bfb-878d-d0b9fac0ea0f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.510550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222caa-8c53-4aed-985e-a5f57397fb7c None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.510923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222caa-8c53-4aed-985e-a5f57397fb7c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.511135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222caa-8c53-4aed-985e-a5f57397fb7c None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.512488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 151/321] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:46.518687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9683-89a0-4d32-a5fd-182fac02bf36 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.519018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9683-89a0-4d32-a5fd-182fac02bf36 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.519296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9683-89a0-4d32-a5fd-182fac02bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.544021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-750b9683-89a0-4d32-a5fd-182fac02bf36 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:46.545368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-750b9683-89a0-4d32-a5fd-182fac02bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:46.564970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:46.570437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154158ef-8d0f-4bfb-878d-d0b9fac0ea0f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.605649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.606362 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.606648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.606953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.617295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:46.625025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:46.625921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:46.626696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 171/322] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:46.631695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.671541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 152/323] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:46.694449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9683-89a0-4d32-a5fd-182fac02bf36 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.717639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:46.734377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c2a4-7740-40a1-9822-d723d864e2f3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.768520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e645-c6ef-4f57-83cd-ee1aab4affd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.769179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e645-c6ef-4f57-83cd-ee1aab4affd3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.769467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e645-c6ef-4f57-83cd-ee1aab4affd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.769758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e645-c6ef-4f57-83cd-ee1aab4affd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.770501 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e645-c6ef-4f57-83cd-ee1aab4affd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:46.770811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e645-c6ef-4f57-83cd-ee1aab4affd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.772202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e645-c6ef-4f57-83cd-ee1aab4affd3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.780358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 172/324] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:46.781545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02fcc9-d036-4fe9-b4a6-084d7510a76d None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.781834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02fcc9-d036-4fe9-b4a6-084d7510a76d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.782118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02fcc9-d036-4fe9-b4a6-084d7510a76d None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.783362 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 173/325] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:46.787552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02fcc9-d036-4fe9-b4a6-084d7510a76d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.794774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9683-89a0-4d32-a5fd-182fac02bf36 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.806946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:46.828978 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a8e74-f60e-403e-80a4-f61a3b3ce5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.829786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8e74-f60e-403e-80a4-f61a3b3ce5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.830071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8e74-f60e-403e-80a4-f61a3b3ce5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.830348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8e74-f60e-403e-80a4-f61a3b3ce5a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.831564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a8e74-f60e-403e-80a4-f61a3b3ce5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.833034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a8e74-f60e-403e-80a4-f61a3b3ce5a2 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.834654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 153/326] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:46.835834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc337b-d13d-4e6c-8a29-f5f18ded1562 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.836117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc337b-d13d-4e6c-8a29-f5f18ded1562 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.836394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc337b-d13d-4e6c-8a29-f5f18ded1562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.852536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-18fc337b-d13d-4e6c-8a29-f5f18ded1562 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:46.853827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-18fc337b-d13d-4e6c-8a29-f5f18ded1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:46.893981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02fcc9-d036-4fe9-b4a6-084d7510a76d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:46.923184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 154/327] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:46.924178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc337b-d13d-4e6c-8a29-f5f18ded1562 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:46.933524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:46.934782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:46.935414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:46.935701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] PATH_INFO: `/v3/users/8dd194e246ae41709ef5136bb7892444` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:46.937431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8dd194e246ae41709ef5136bb7892444)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:46.939141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:46.940636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 174/328] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:46 2022] GET /identity/v3/users/8dd194e246ae41709ef5136bb7892444 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:46.945570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:46.946370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:47.022325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc337b-d13d-4e6c-8a29-f5f18ded1562 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.034254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:47.046081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1283-31c7-4f05-90cf-7792004df1f3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.055768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.056523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.056811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.057091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] PATH_INFO: `/v3/groups` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.057782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.059262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:47.078868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.079536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.079803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.080078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.080900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] RBAC: Adding query filter params (role.id=3fdad772aeff41e29a0619cd969d9f72, user.id=8dd194e246ae41709ef5136bb7892444, scope.system=all) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:47.081211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.082625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:47.093703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 175/329] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 22 08:48:46 2022] GET /identity/v3/role_assignments?user.id=8dd194e246ae41709ef5136bb7892444&scope.system=all&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 510 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:47.094467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:47.138173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 155/330] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jun 22 08:48:46 2022] POST /identity/v3/groups => generated 226 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:48:47.210580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5335-1560-40bc-bb4b-29ae337451e8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.250075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.250926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.251213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.251492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.264638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:47.272589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:47.273541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:47.274496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 176/331] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:47.280092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:47.371757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:47.390946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4157ac-1a85-4415-9f67-3574d6ab0b7d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.429356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.430070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.430356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.430645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.431446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:47.431760 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.433154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:47.442463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 156/332] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:47.447561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:47.457303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:47.556745 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e577-c0ab-4c3c-9f8e-f50c3c57d491 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.594722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c6f51-c224-4542-92c0-cc6927c54e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.595629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c6f51-c224-4542-92c0-cc6927c54e52 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.595914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c6f51-c224-4542-92c0-cc6927c54e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.596190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c6f51-c224-4542-92c0-cc6927c54e52 None admin] PATH_INFO: `/v3/users/4b73c6571ac14dffba24433ed0fe92e9` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.597532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c6f51-c224-4542-92c0-cc6927c54e52 None admin] RBAC: Authorizing `identity:get_user(user_id=4b73c6571ac14dffba24433ed0fe92e9)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.599592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c6f51-c224-4542-92c0-cc6927c54e52 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:47.601030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 177/333] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:47 2022] GET /identity/v3/users/4b73c6571ac14dffba24433ed0fe92e9 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:47.606652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:47.716341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe679e5-8d4c-48a8-a324-b9eaedddaa5e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:47.754926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f638996-21d9-48e6-81ef-5101bf7e443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:47.756127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f638996-21d9-48e6-81ef-5101bf7e443c None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:47.756595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f638996-21d9-48e6-81ef-5101bf7e443c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:47.757056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f638996-21d9-48e6-81ef-5101bf7e443c None admin] PATH_INFO: `/v3/system/users/4b73c6571ac14dffba24433ed0fe92e9/roles/ac4cc313a39d4e44a54f41461198e989` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:47.758760 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f638996-21d9-48e6-81ef-5101bf7e443c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4b73c6571ac14dffba24433ed0fe92e9, role_id=ac4cc313a39d4e44a54f41461198e989)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:47.760431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f638996-21d9-48e6-81ef-5101bf7e443c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:47.834335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 157/334] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jun 22 08:48:47 2022] PUT /identity/v3/system/users/4b73c6571ac14dffba24433ed0fe92e9/roles/ac4cc313a39d4e44a54f41461198e989 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:50.205039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66323-3891-423a-a2ea-96f231e90162 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.206051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66323-3891-423a-a2ea-96f231e90162 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.206567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66323-3891-423a-a2ea-96f231e90162 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.208450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 178/335] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:50.213302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abe74-45a8-4ba3-92aa-862a44954152 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.214113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abe74-45a8-4ba3-92aa-862a44954152 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.214606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abe74-45a8-4ba3-92aa-862a44954152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.227228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:50.234014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-539abe74-45a8-4ba3-92aa-862a44954152 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:50.235467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-539abe74-45a8-4ba3-92aa-862a44954152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:50.309544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 158/336] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:50.355932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d66323-3891-423a-a2ea-96f231e90162 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:50.523265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:50.569375 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d66323-3891-423a-a2ea-96f231e90162 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:50.582517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf860-b245-4a69-b886-e582ace06680 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.583652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf860-b245-4a69-b886-e582ace06680 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.584140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf860-b245-4a69-b886-e582ace06680 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.590919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 159/337] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:50.597269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e740e-04d1-43b4-b4ad-23d0f2d50672 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.597789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e740e-04d1-43b4-b4ad-23d0f2d50672 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.598381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e740e-04d1-43b4-b4ad-23d0f2d50672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.630899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-de9e740e-04d1-43b4-b4ad-23d0f2d50672 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:50.633758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-de9e740e-04d1-43b4-b4ad-23d0f2d50672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:50.659959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:50.661318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:50.661992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:50.662311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:50.696133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:50.741126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:50.742110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:50.742959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:50.747819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 179/338] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:48:50.755810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:50.863849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 160/339] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:50.899805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e740e-04d1-43b4-b4ad-23d0f2d50672 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.003324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.023396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991a70-1fa3-4ebc-8ead-d71af1e2632a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.051907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e740e-04d1-43b4-b4ad-23d0f2d50672 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.093311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494faef9-abc2-49fe-a1b0-ff8c1d619094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.093998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faef9-abc2-49fe-a1b0-ff8c1d619094 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.094279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faef9-abc2-49fe-a1b0-ff8c1d619094 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.094554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faef9-abc2-49fe-a1b0-ff8c1d619094 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.095983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faef9-abc2-49fe-a1b0-ff8c1d619094 None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:51.096294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faef9-abc2-49fe-a1b0-ff8c1d619094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:51.097889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faef9-abc2-49fe-a1b0-ff8c1d619094 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:51.103566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.110383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00fa74-485c-4965-aa41-4201b6b7976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.111279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00fa74-485c-4965-aa41-4201b6b7976b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.111831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00fa74-485c-4965-aa41-4201b6b7976b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.112111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00fa74-485c-4965-aa41-4201b6b7976b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.118808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 180/340] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:51.121421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca2ff-6708-4b98-9cc1-021764ce064c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.121710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca2ff-6708-4b98-9cc1-021764ce064c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.121992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca2ff-6708-4b98-9cc1-021764ce064c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.123371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 181/341] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:51.129892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca2ff-6708-4b98-9cc1-021764ce064c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.136224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00fa74-485c-4965-aa41-4201b6b7976b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-ef00fa74-485c-4965-aa41-4201b6b7976b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:51.153793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:51.155382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:51.156165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:51.159088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 161/342] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:51.161339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3de9-9ab3-421b-955d-de584fe4f71d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.161629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3de9-9ab3-421b-955d-de584fe4f71d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.161910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3de9-9ab3-421b-955d-de584fe4f71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.195785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6f5d3de9-9ab3-421b-955d-de584fe4f71d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:51.197391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6f5d3de9-9ab3-421b-955d-de584fe4f71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:51.319678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca2ff-6708-4b98-9cc1-021764ce064c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.332392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 162/343] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:51.333259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3de9-9ab3-421b-955d-de584fe4f71d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.367902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.368560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.369433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.369657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.410360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.433940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.441233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:51.442720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:51.459642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3de9-9ab3-421b-955d-de584fe4f71d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.500025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243c1cb-ceb7-40d0-adcd-62b0212a220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.500958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c1cb-ceb7-40d0-adcd-62b0212a220a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.501241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c1cb-ceb7-40d0-adcd-62b0212a220a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.501513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c1cb-ceb7-40d0-adcd-62b0212a220a None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.503496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243c1cb-ceb7-40d0-adcd-62b0212a220a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:51.503956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243c1cb-ceb7-40d0-adcd-62b0212a220a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:51.505354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243c1cb-ceb7-40d0-adcd-62b0212a220a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:51.515220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 163/344] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:51.516562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24c487-f241-4d74-9de9-f8a31f707286 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.516846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24c487-f241-4d74-9de9-f8a31f707286 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.517123 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24c487-f241-4d74-9de9-f8a31f707286 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.518333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 164/345] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:51.523681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24c487-f241-4d74-9de9-f8a31f707286 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.547583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 182/346] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:48:51.548458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.650936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.656688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bacd7-592d-4f2d-affd-7eb1aa810dac None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.686524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24c487-f241-4d74-9de9-f8a31f707286 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.702156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a11df8-566a-479d-8ab9-7138a26bb526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.702800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a11df8-566a-479d-8ab9-7138a26bb526 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.703112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a11df8-566a-479d-8ab9-7138a26bb526 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.703385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a11df8-566a-479d-8ab9-7138a26bb526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.707769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.732246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1d837-b13b-4815-b5d8-e61d366be76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:51.734566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d837-b13b-4815-b5d8-e61d366be76d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.734566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d837-b13b-4815-b5d8-e61d366be76d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.734737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d837-b13b-4815-b5d8-e61d366be76d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.748930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1d837-b13b-4815-b5d8-e61d366be76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-c4b1d837-b13b-4815-b5d8-e61d366be76d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:51.757134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:51.758146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:51.759001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:51.759624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 165/347] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:51.760462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f0e6-4db0-4f19-8fd5-7d872230ab09 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.760757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f0e6-4db0-4f19-8fd5-7d872230ab09 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.761041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f0e6-4db0-4f19-8fd5-7d872230ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.779996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-53d7f0e6-4db0-4f19-8fd5-7d872230ab09 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:51.781200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-53d7f0e6-4db0-4f19-8fd5-7d872230ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:51.797356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a11df8-566a-479d-8ab9-7138a26bb526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:51.799912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a11df8-566a-479d-8ab9-7138a26bb526 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:51.874133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 166/348] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:51.875045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f0e6-4db0-4f19-8fd5-7d872230ab09 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.928143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:51.938949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 183/349] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:51.940573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4e95-e181-4689-bcc0-ab31d26e25c5 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:51.941088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4e95-e181-4689-bcc0-ab31d26e25c5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:51.941298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b4e95-e181-4689-bcc0-ab31d26e25c5 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:51.942781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 184/350] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:51.946739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b4e95-e181-4689-bcc0-ab31d26e25c5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:51.988437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f0e6-4db0-4f19-8fd5-7d872230ab09 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:51.999172 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.030608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57442575-743a-4a58-a207-fb35d0f18927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.031623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57442575-743a-4a58-a207-fb35d0f18927 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.031950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57442575-743a-4a58-a207-fb35d0f18927 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.032243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57442575-743a-4a58-a207-fb35d0f18927 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.033824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57442575-743a-4a58-a207-fb35d0f18927 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.035727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57442575-743a-4a58-a207-fb35d0f18927 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.037907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 167/351] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:51 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:52.039877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e5232-df13-4582-ab82-a4f5a03db5a2 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.039877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e5232-df13-4582-ab82-a4f5a03db5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.040417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e5232-df13-4582-ab82-a4f5a03db5a2 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.042110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 168/352] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:52.047279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e5232-df13-4582-ab82-a4f5a03db5a2 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.068621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b4e95-e181-4689-bcc0-ab31d26e25c5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.112958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.113755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.114044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.114323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.115112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:52.115420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.116810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.126036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 185/353] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:52.127788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.173954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e5232-df13-4582-ab82-a4f5a03db5a2 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.199881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.211443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ca5fb-f4b6-4dd9-b58c-43c463054a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.214950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ca5fb-f4b6-4dd9-b58c-43c463054a77 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.214950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ca5fb-f4b6-4dd9-b58c-43c463054a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.214950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ca5fb-f4b6-4dd9-b58c-43c463054a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.225119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ca5fb-f4b6-4dd9-b58c-43c463054a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-548ca5fb-f4b6-4dd9-b58c-43c463054a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:52.233541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:52.234677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:52.235905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 169/354] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:52.236969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26835-bc13-4207-9930-e8327aa9a2d8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.236969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26835-bc13-4207-9930-e8327aa9a2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.236969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26835-bc13-4207-9930-e8327aa9a2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.255434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-4ff26835-bc13-4207-9930-e8327aa9a2d8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:52.256213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab468b-f47a-471b-af22-bf4b1104faa2 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.256638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4ff26835-bc13-4207-9930-e8327aa9a2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:52.290326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.301202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942cd9f-5313-4b2a-aa52-abf53600c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.304880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942cd9f-5313-4b2a-aa52-abf53600c571 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.304880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942cd9f-5313-4b2a-aa52-abf53600c571 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.304880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942cd9f-5313-4b2a-aa52-abf53600c571 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.304880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942cd9f-5313-4b2a-aa52-abf53600c571 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.306015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942cd9f-5313-4b2a-aa52-abf53600c571 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.307813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 186/355] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:52.308972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193ae4-3f8d-44d6-b0d3-2903222863a8 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.309256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193ae4-3f8d-44d6-b0d3-2903222863a8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.309544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193ae4-3f8d-44d6-b0d3-2903222863a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.327281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b1193ae4-3f8d-44d6-b0d3-2903222863a8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:52.329559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b1193ae4-3f8d-44d6-b0d3-2903222863a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:52.343548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 170/356] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:52.344636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff26835-bc13-4207-9930-e8327aa9a2d8 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.416388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 187/357] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:52.417121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193ae4-3f8d-44d6-b0d3-2903222863a8 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.466944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff26835-bc13-4207-9930-e8327aa9a2d8 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.484779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.518510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.520024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.522860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.522860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.527557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.529280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.532061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 171/358] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:52.533067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.537181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193ae4-3f8d-44d6-b0d3-2903222863a8 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.580472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.581129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.581419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.582502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.582621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.663172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.664544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.667167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78673-3af6-48e2-8c71-81ac55c7fbf6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.707062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.708016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.708127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.708322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.709109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:52.709416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.710788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.723602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 172/359] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:52.724678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.738100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.789071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 188/360] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:52.790465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.832261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:52.846900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72b34b-9bcd-40ea-bd25-2e45cae5976f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.888780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.890206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.890497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.891437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.892680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:52.894962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:52.896796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 173/361] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:52.897495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:52.926988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1e96-3c69-4017-861a-40cedbc373a7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:52.971034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:52.971855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:52.972129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:52.972407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:52.983513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:52.991762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:52.992869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:52.993678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 189/362] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:52.994419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.009301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4236e35-67eb-40e7-8085-882e83714a4b None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.012452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.042747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.043589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.043874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.044215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.055012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:53.063168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:53.064202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:53.065004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 174/363] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:53.066072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.087710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.096463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef8561-31d6-436f-bf02-90b000018390 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.130754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.131426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.131712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.131998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.132830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=e9470df72a334ba29e4da06067e1d428) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:53.133140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.134571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.140071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 190/364] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:48:52 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 260 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:53.140682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.168266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d12ee-78c4-4faa-b4f5-7ea65634ab14 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.210654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.212185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.212746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.213196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.232347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.253914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a42ab-a07b-4145-9740-eae84aad2c1a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.290277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.291187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.291472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.291751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.292974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.294466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.294581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.296527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.296891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 191/365] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:53.302213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.323795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.416422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 175/366] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:53.417069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b7a3-7d53-420d-997c-956ae38bf510 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.417421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.454016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.454954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.455238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.455606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.456461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=e9470df72a334ba29e4da06067e1d428) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:53.456773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.458192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.474869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 192/367] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:53.474869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.490712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.548579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18a16-4aec-4fa3-823f-9da0871c938c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.571996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.587574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292b206-d178-4304-86b8-3edfbdda74ca None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.589468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.590439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.590987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.591516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.593073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:53.593611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.595342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.606354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 176/368] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:53.608259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.627641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.628328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.628616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.628896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.629662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:53.629969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.631678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.645231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 193/369] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:53.645231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.731124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.750507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6857b5-9cb3-4851-b651-4cf532f28bc9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.761949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238905d-5273-472a-bde1-23fe6149beb1 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.787939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.788788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.789066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.789337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.790854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.792049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.799254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 177/370] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:53.800070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.808633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.810287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.810761 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.811740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] PATH_INFO: `/v3/projects/220b7f5f59544863b1dda75a37a7b01f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.813578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] RBAC: Authorizing `identity:get_project(project_id=220b7f5f59544863b1dda75a37a7b01f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:53.815776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:53.818792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 194/371] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/projects/220b7f5f59544863b1dda75a37a7b01f => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:53.820005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:53.856689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:53.910401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab34f75-251b-494b-9b2f-aee86dd31f37 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:53.946953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:53.947709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:53.948055 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:53.948400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:53.959827 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d28fb6-c01b-4b54-8275-00d22a3115a0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.009524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.010400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.010686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.011010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] PATH_INFO: `/v3/users/4b73c6571ac14dffba24433ed0fe92e9` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.013032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] RBAC: Authorizing `identity:get_user(user_id=4b73c6571ac14dffba24433ed0fe92e9)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.015876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.018048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 195/372] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/users/4b73c6571ac14dffba24433ed0fe92e9 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:54.019649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:54.033354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.034817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.039708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:54.087824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:54.147307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7382d-9d15-4532-bb25-2f2380cb0d94 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.160839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 178/373] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:48:54.161742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:54.190031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.190942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.191357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.192053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.193153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:54.193471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.195104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.207026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 196/374] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:54.208001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:54.339127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375de2-fd42-4559-b69a-b826ca4fd71c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.396446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.397329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.397612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.397889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] PATH_INFO: `/v3/groups/156819c72cb94d6c8286d414555d8d6d` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.400104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:54.409985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] RBAC: Authorizing `identity:get_group(group_id=156819c72cb94d6c8286d414555d8d6d)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.411500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.418592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 179/375] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/groups/156819c72cb94d6c8286d414555d8d6d => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:54.418592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:54.434409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:54.443790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697e7ac-f86f-4404-ae0a-40d3c9a379ad None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.497470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.498162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.498452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.498772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.499639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] RBAC: Adding query filter params (role.id=ac4cc313a39d4e44a54f41461198e989, user.id=4b73c6571ac14dffba24433ed0fe92e9, scope.system=all) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:54.499953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.501394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.527585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 197/376] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/role_assignments?user.id=4b73c6571ac14dffba24433ed0fe92e9&scope.system=all&role.id=ac4cc313a39d4e44a54f41461198e989 => generated 510 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:54.528430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:54.574701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ce233-be3b-49ef-9ae7-84ef2168cdd4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.661900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.662714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.663027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.663309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.664869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.666345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.670068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 180/377] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:54.680570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:54.770331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f2f90-0290-43ee-90ce-2f89f223c7ef None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.827218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:54.828420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:54.841137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051ed2e-418d-476f-b68b-19ed32036dc3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:54.855599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.856407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.856787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.857137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.858166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] RBAC: Adding query filter params (group.id=156819c72cb94d6c8286d414555d8d6d, role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=220b7f5f59544863b1dda75a37a7b01f) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:54.858561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.860126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.873765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 198/378] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/role_assignments?group.id=156819c72cb94d6c8286d414555d8d6d&scope.project.id=220b7f5f59544863b1dda75a37a7b01f&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 260 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:54.882098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5467c-6911-41ef-afb7-ca05422aec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:54.883406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5467c-6911-41ef-afb7-ca05422aec80 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:54.883907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5467c-6911-41ef-afb7-ca05422aec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:54.884443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5467c-6911-41ef-afb7-ca05422aec80 None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:54.888485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5467c-6911-41ef-afb7-ca05422aec80 None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:54.890968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5467c-6911-41ef-afb7-ca05422aec80 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:54.892922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 181/379] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:54.898628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.012573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f14b-a32f-44d9-a5cd-1f5279327b66 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.051371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb30b43-083d-4ce5-97f3-4e4bf152f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.052416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb30b43-083d-4ce5-97f3-4e4bf152f04d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.052933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb30b43-083d-4ce5-97f3-4e4bf152f04d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.053434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb30b43-083d-4ce5-97f3-4e4bf152f04d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.054505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb30b43-083d-4ce5-97f3-4e4bf152f04d None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:55.055063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb30b43-083d-4ce5-97f3-4e4bf152f04d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.056772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb30b43-083d-4ce5-97f3-4e4bf152f04d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:55.064526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 199/380] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:48:54 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:55.449334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed06e7-9e9c-4f52-ad95-5bc061b20a74 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.449829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed06e7-9e9c-4f52-ad95-5bc061b20a74 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.449903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed06e7-9e9c-4f52-ad95-5bc061b20a74 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.451604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 182/381] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:55.457186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe00a4-1bb8-4f0d-bc8c-824da8c86858 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.457601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe00a4-1bb8-4f0d-bc8c-824da8c86858 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.457776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe00a4-1bb8-4f0d-bc8c-824da8c86858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.478945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5dfe00a4-1bb8-4f0d-bc8c-824da8c86858 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:55.480186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5dfe00a4-1bb8-4f0d-bc8c-824da8c86858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.552856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:55.569572 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 200/382] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:55.601713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed06e7-9e9c-4f52-ad95-5bc061b20a74 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.738024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed06e7-9e9c-4f52-ad95-5bc061b20a74 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.778641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51690b76-2958-4804-a045-d0ff5317ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.780018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690b76-2958-4804-a045-d0ff5317ab4a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.780305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690b76-2958-4804-a045-d0ff5317ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.780577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51690b76-2958-4804-a045-d0ff5317ab4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.797528 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51690b76-2958-4804-a045-d0ff5317ab4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-51690b76-2958-4804-a045-d0ff5317ab4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:55.805381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:55.806284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:55.807139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 183/383] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:55.816626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe00a4-1bb8-4f0d-bc8c-824da8c86858 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:55.939313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe00a4-1bb8-4f0d-bc8c-824da8c86858 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:55.955062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0e9f0-cdd0-4295-85bf-e4bac7214577 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.955371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0e9f0-cdd0-4295-85bf-e4bac7214577 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.955638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0e9f0-cdd0-4295-85bf-e4bac7214577 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.957316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 184/384] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:55.963131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d6fb4-9120-4893-936c-133c23c447bf None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.963430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d6fb4-9120-4893-936c-133c23c447bf None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.963716 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d6fb4-9120-4893-936c-133c23c447bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.988769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9f4d6fb4-9120-4893-936c-133c23c447bf None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:55.990400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9f4d6fb4-9120-4893-936c-133c23c447bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:55.993098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:55.993776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:55.994873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:55.995003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:55.995267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:55.996030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:55.996335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:55.997699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.006315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 201/385] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:56.024705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.085334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 185/386] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:56.107247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:56.121176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d6fb4-9120-4893-936c-133c23c447bf None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.156182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0164f0-ad6a-4ad7-911e-8d4885f8bcdf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.194096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.196127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.196656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.197139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.204681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.206303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.210213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 202/387] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:56.215784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.322817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d6fb4-9120-4893-936c-133c23c447bf None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.337691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98517092-2766-4391-b1fc-1ae760897256 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.367261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:56.379439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.380579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.381084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.381602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.383155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.385122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.387455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 203/388] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:56.398857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.416334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.417160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.417501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.417785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.434533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:56.439474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:56.452207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:56.453529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:56.454906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 186/389] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:56.461741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.602639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d0062-0593-4d19-899f-15c6f49dedaf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.623752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04f2dd-cf58-4119-8809-de56740b2717 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.657914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f88908-c823-454d-9dc2-28c736df6db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.658797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88908-c823-454d-9dc2-28c736df6db3 None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.659117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88908-c823-454d-9dc2-28c736df6db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.659400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88908-c823-454d-9dc2-28c736df6db3 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428/groups/0a45b22075184f889470a50cb858a49e/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.661651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f88908-c823-454d-9dc2-28c736df6db3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9470df72a334ba29e4da06067e1d428, group_id=0a45b22075184f889470a50cb858a49e, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.663259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f88908-c823-454d-9dc2-28c736df6db3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.677957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.678626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.678934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.679211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.679956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:56.680263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.681690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.690571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 187/390] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:56.696300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.762266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 204/391] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 22 08:48:56 2022] PUT /identity/v3/projects/e9470df72a334ba29e4da06067e1d428/groups/0a45b22075184f889470a50cb858a49e/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:56.766851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:56.806788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283540cd-a5ef-4cd8-98d8-e363400f01e7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.834365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe76e-12f4-4088-a31b-2eb593aa1edc None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.834666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe76e-12f4-4088-a31b-2eb593aa1edc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.834939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe76e-12f4-4088-a31b-2eb593aa1edc None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.836374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 205/392] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:56.841802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c306-20ca-4e40-8d79-a8560497fa86 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.842109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c306-20ca-4e40-8d79-a8560497fa86 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.842399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c306-20ca-4e40-8d79-a8560497fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.851133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:56.853875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:56.853875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:56.853875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:56.860881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:56.862631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:56.864704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 188/393] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:56.870268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:56.873595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c910c306-20ca-4e40-8d79-a8560497fa86 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:56.874806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c910c306-20ca-4e40-8d79-a8560497fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:56.967230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:56.977113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b83421-c5e7-45f8-b1f2-3c2927bcc313 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:56.996979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 206/394] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:57.008333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.015007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.020558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.020558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.020558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.020558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.020558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.021054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 189/395] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:56 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:57.021147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c306-20ca-4e40-8d79-a8560497fa86 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.026285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.128256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967d02-416c-4c51-be68-99b0ddc73826 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.183011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.185114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.185400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.185709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428/groups/0a45b22075184f889470a50cb858a49e/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.189457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] RBAC: Authorizing `identity:create_grant(project_id=e9470df72a334ba29e4da06067e1d428, group_id=0a45b22075184f889470a50cb858a49e, role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.190915 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.193829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c306-20ca-4e40-8d79-a8560497fa86 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.233623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.234417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.234694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.234993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.245596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:57.253506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:57.254437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:57.255295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 207/396] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:57.267786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.307122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 190/397] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 22 08:48:57 2022] PUT /identity/v3/projects/e9470df72a334ba29e4da06067e1d428/groups/0a45b22075184f889470a50cb858a49e/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:48:57.323937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.421354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da192f0e-8936-4a56-89d4-e8887756ab04 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.471114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236909ff-3afa-40fb-86f0-d61691dea932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.471848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236909ff-3afa-40fb-86f0-d61691dea932 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.472131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236909ff-3afa-40fb-86f0-d61691dea932 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.472402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236909ff-3afa-40fb-86f0-d61691dea932 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.473163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236909ff-3afa-40fb-86f0-d61691dea932 None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:57.473465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236909ff-3afa-40fb-86f0-d61691dea932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.474867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236909ff-3afa-40fb-86f0-d61691dea932 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.483699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 208/398] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:57.489728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.559631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07be5a-685b-4c1e-b19c-1984768f80c2 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.559965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07be5a-685b-4c1e-b19c-1984768f80c2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.560181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07be5a-685b-4c1e-b19c-1984768f80c2 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.562262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 209/399] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:57.567883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c6fc3-59d7-4f44-9685-8933548945d7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.568494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c6fc3-59d7-4f44-9685-8933548945d7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.569359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c6fc3-59d7-4f44-9685-8933548945d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.573220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.588479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-771c6fc3-59d7-4f44-9685-8933548945d7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:57.590081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-771c6fc3-59d7-4f44-9685-8933548945d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:57.647031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6fc91-7b22-4eb9-b6d6-b4e12da0df2a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.693885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 210/400] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:57.695968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88038a2-fda5-4655-b5f2-5ea8c79820e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.697017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88038a2-fda5-4655-b5f2-5ea8c79820e8 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.697800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88038a2-fda5-4655-b5f2-5ea8c79820e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.698140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88038a2-fda5-4655-b5f2-5ea8c79820e8 None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.699419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88038a2-fda5-4655-b5f2-5ea8c79820e8 None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.700927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88038a2-fda5-4655-b5f2-5ea8c79820e8 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.702620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 191/401] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:57 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:57.708258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c6fc3-59d7-4f44-9685-8933548945d7 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.716479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fafbe-659c-40ef-bbcd-55115ec611b1 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.716886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fafbe-659c-40ef-bbcd-55115ec611b1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.717718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fafbe-659c-40ef-bbcd-55115ec611b1 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.719880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 192/402] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:57.723750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fafbe-659c-40ef-bbcd-55115ec611b1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.744516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.829221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c6fc3-59d7-4f44-9685-8933548945d7 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.851797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fafbe-659c-40ef-bbcd-55115ec611b1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:57.878654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaf750-b300-4f3b-8444-b097ecef4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.879832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaf750-b300-4f3b-8444-b097ecef4b18 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.880116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaf750-b300-4f3b-8444-b097ecef4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.880398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaf750-b300-4f3b-8444-b097ecef4b18 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:57.882423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaf750-b300-4f3b-8444-b097ecef4b18 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:57.884579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaf750-b300-4f3b-8444-b097ecef4b18 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:57.890854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 211/403] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:57 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:57.890854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b567d-6a8a-42fb-8a39-bd8df5611b4a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.890854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b567d-6a8a-42fb-8a39-bd8df5611b4a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.890854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b567d-6a8a-42fb-8a39-bd8df5611b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.896352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:57.897373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:57.897835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:57.898306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:57.907952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4e1b567d-6a8a-42fb-8a39-bd8df5611b4a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:57.909243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4e1b567d-6a8a-42fb-8a39-bd8df5611b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:57.911166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:57.921136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:57.922058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:48:57.923162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:57.930482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 193/404] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:57.931580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:57.993848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 212/405] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:58.003483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b567d-6a8a-42fb-8a39-bd8df5611b4a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.043461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16d8f-bacd-437b-a2cb-16c3eda4fa44 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.069465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.086716 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.087951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.088447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.089100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/groups/0a45b22075184f889470a50cb858a49e/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.092722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] RBAC: Authorizing `identity:create_grant(project_id=9b24f237e88b4ae0ae0f2b490dbacaca, group_id=0a45b22075184f889470a50cb858a49e, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.095323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.130855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b567d-6a8a-42fb-8a39-bd8df5611b4a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.166373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.167070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.167353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.167626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.168358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:58.168719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.170639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.183959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 213/406] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:48:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:58.183959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.206582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 194/407] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 22 08:48:57 2022] PUT /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/groups/0a45b22075184f889470a50cb858a49e/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:58.213406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.320106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.359406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.391439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479d3f3-29ad-4459-b50d-4036fb16f9ba None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.434003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a12d4-3bbc-45af-b243-17cfc58c42ee None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.448903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.450211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.450647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.451788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.465817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:58.474416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.475482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.475894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.476266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:58.477034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:58.478113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:48:58.478968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:48:58.479593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.480753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.481543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 214/408] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:58.486966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 195/409] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:58 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:58.487925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.488360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.668137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80775cf3-c1f0-4117-8ecf-c1bafe65c8de None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.682973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfa395-c585-425a-b785-da37003d0d45 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.696670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.733891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.735517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.735803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.736081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.737805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.739287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.743687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 196/410] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:58 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:58.749004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.750731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.753060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.753060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.753060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.753060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:58.753060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.754316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.770660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 215/411] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:58.775983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:58.792316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:58.889354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be0967-8b20-4d6c-9959-2bfa45a4fb61 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.908530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709afda-7abd-4e08-8c11-3cba42b30115 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:58.949219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.950103 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.950387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.950665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/groups/0a45b22075184f889470a50cb858a49e/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.955131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] RBAC: Authorizing `identity:create_grant(project_id=9b24f237e88b4ae0ae0f2b490dbacaca, group_id=0a45b22075184f889470a50cb858a49e, role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.956576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.968659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:58.979146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:58.979146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:58.979146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] PATH_INFO: `/v3/groups/156819c72cb94d6c8286d414555d8d6d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:58.979146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] RBAC: Authorizing `identity:get_group(group_id=156819c72cb94d6c8286d414555d8d6d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:58.979146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:58.979146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 216/412] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:48:58 2022] GET /identity/v3/groups/156819c72cb94d6c8286d414555d8d6d => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:48:58.980310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.042411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 197/413] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 22 08:48:58 2022] PUT /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca/groups/0a45b22075184f889470a50cb858a49e/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:59.074162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.094357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad6b1-a621-44cb-b32d-583e0a25a365 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.147670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854414-fc22-4a07-9184-32d30bb14b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.148576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854414-fc22-4a07-9184-32d30bb14b94 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.148865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854414-fc22-4a07-9184-32d30bb14b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.149143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854414-fc22-4a07-9184-32d30bb14b94 None admin] PATH_INFO: `/v3/projects/220b7f5f59544863b1dda75a37a7b01f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.150444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854414-fc22-4a07-9184-32d30bb14b94 None admin] RBAC: Authorizing `identity:get_project(project_id=220b7f5f59544863b1dda75a37a7b01f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.152118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854414-fc22-4a07-9184-32d30bb14b94 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.154266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 217/414] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:48:58 2022] GET /identity/v3/projects/220b7f5f59544863b1dda75a37a7b01f => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:59.160181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.218377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.282550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb273-481b-4d62-bc28-ec7f2749b2bf None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.321052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.321939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.322224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.322567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] PATH_INFO: `/v3/projects/220b7f5f59544863b1dda75a37a7b01f/groups/156819c72cb94d6c8286d414555d8d6d/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.324633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] RBAC: Authorizing `identity:create_grant(project_id=220b7f5f59544863b1dda75a37a7b01f, group_id=156819c72cb94d6c8286d414555d8d6d, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.326114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.370074 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea46f5-0225-4743-b677-005356f9c9da None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.370371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea46f5-0225-4743-b677-005356f9c9da None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.370723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea46f5-0225-4743-b677-005356f9c9da None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.372390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 218/415] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:48:59.378175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a444-0ddd-4841-903a-0a89ddfeda45 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.378465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a444-0ddd-4841-903a-0a89ddfeda45 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.378748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a444-0ddd-4841-903a-0a89ddfeda45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.395824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9616a444-0ddd-4841-903a-0a89ddfeda45 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.397067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9616a444-0ddd-4841-903a-0a89ddfeda45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.430603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 198/416] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 22 08:48:59 2022] PUT /identity/v3/projects/220b7f5f59544863b1dda75a37a7b01f/groups/156819c72cb94d6c8286d414555d8d6d/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:48:59.488678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 219/417] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:48:59.529943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.667151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec5b2e-211e-429b-81f7-c9425e2cddbb None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.668824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.706523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18da1a-f139-4b3e-8c02-81b5c442d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.707828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18da1a-f139-4b3e-8c02-81b5c442d13b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.708356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18da1a-f139-4b3e-8c02-81b5c442d13b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.708842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18da1a-f139-4b3e-8c02-81b5c442d13b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.722147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18da1a-f139-4b3e-8c02-81b5c442d13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-bf18da1a-f139-4b3e-8c02-81b5c442d13b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:48:59.730546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:48:59.731530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:48:59.732984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:48:59.743284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 199/418] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:48:59.743426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a444-0ddd-4841-903a-0a89ddfeda45 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.745262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e9c6-0969-4bb9-a1b9-5d633ec35ab7 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.745553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e9c6-0969-4bb9-a1b9-5d633ec35ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.745829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46e9c6-0969-4bb9-a1b9-5d633ec35ab7 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.747460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 200/419] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:48:59.754305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4877e-0485-4f61-810a-ee07c4ca8637 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.754590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4877e-0485-4f61-810a-ee07c4ca8637 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.754954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4877e-0485-4f61-810a-ee07c4ca8637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.773315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-78b4877e-0485-4f61-810a-ee07c4ca8637 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:48:59.774516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-78b4877e-0485-4f61-810a-ee07c4ca8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:48:59.844454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:48:59.852515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 201/420] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:48:59.871626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a444-0ddd-4841-903a-0a89ddfeda45 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:48:59.922314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:48:59.923009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:48:59.923294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:48:59.923568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:48:59.924318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:48:59.924622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:48:59.925997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:48:59.934838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 220/421] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:48:59.940088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:48:59.940960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4877e-0485-4f61-810a-ee07c4ca8637 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.112796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.126612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4877e-0485-4f61-810a-ee07c4ca8637 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.134948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6945870-ce31-4b7d-ba2f-67196c447e4f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.173084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.173740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.174027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.174313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.180122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.180940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.181227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.181506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.186260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.198990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:00.201658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:00.202555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:00.203384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 202/422] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:00.216641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.264495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.266515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.376519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 221/423] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:48:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:00.382142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.426528 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94108dc3-e7eb-4eea-aaf8-140de8d4a7b9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.467015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.468048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.468554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.469030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.469997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:00.470504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.472550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.482475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 203/424] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:00.482618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.488760 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.507804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.583023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82367ee1-83d7-4f8b-93cc-e16972549428 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.621139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.622008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.622292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.622573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.624491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.625949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.628187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 222/425] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:00.634049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.692971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803c095-06dd-4f09-b8ee-d6ee5d9727ab None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.726715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bb131-98c9-4e45-82ed-a875d6ea5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.727367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bb131-98c9-4e45-82ed-a875d6ea5d45 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.727659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bb131-98c9-4e45-82ed-a875d6ea5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.727940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bb131-98c9-4e45-82ed-a875d6ea5d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.762180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af3495-037a-4bd8-ace2-032001811ccc None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.797819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bb131-98c9-4e45-82ed-a875d6ea5d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.799315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8547d-779c-4052-994e-067d1396870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.799442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bb131-98c9-4e45-82ed-a875d6ea5d45 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.800488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8547d-779c-4052-994e-067d1396870f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.801090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8547d-779c-4052-994e-067d1396870f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.801737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8547d-779c-4052-994e-067d1396870f None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.803183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.804222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8547d-779c-4052-994e-067d1396870f None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.805862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8547d-779c-4052-994e-067d1396870f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.808138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 223/426] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:00.809609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905590db-11cf-4a37-bc40-0971fc0d2579 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.810099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905590db-11cf-4a37-bc40-0971fc0d2579 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.811150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905590db-11cf-4a37-bc40-0971fc0d2579 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.816982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 224/427] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:00.817957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905590db-11cf-4a37-bc40-0971fc0d2579 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:00.824697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:00.913560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 204/428] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:49:00.913560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb9590-ef07-4073-ba70-3b4315dd7b69 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.913560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb9590-ef07-4073-ba70-3b4315dd7b69 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.913560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb9590-ef07-4073-ba70-3b4315dd7b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.928858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-26eb9590-ef07-4073-ba70-3b4315dd7b69 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:00.930069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-26eb9590-ef07-4073-ba70-3b4315dd7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:00.939709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905590db-11cf-4a37-bc40-0971fc0d2579 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:00.977955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:00.979075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:00.979636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:00.980126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:00.981154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=e9470df72a334ba29e4da06067e1d428) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:00.981765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:00.984083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:00.991146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 225/429] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:00.992311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.020954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 205/430] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:01.050345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb9590-ef07-4073-ba70-3b4315dd7b69 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.090736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.157202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.219257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb9590-ef07-4073-ba70-3b4315dd7b69 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.220136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1593d-5cbb-4b76-933e-b3eeff8330f4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.263184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.264142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.264434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.264715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] PATH_INFO: `/v3/projects/e9470df72a334ba29e4da06067e1d428` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.266060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] RBAC: Authorizing `identity:get_project(project_id=e9470df72a334ba29e4da06067e1d428)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.267688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.268885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.269509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 226/431] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:49:00 2022] GET /identity/v3/projects/e9470df72a334ba29e4da06067e1d428 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:01.270153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.270630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.271146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.275128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.283811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:01.292614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:01.293543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:49:01.294358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:01.297901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 206/432] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:01.303734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.387790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb511e-1d08-4b58-bdc0-6a347fdc8f40 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.398260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.423980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af63dc-7577-4b9c-b957-31e91e252b78 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.427781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.436012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb452ec-bcf0-4fba-8879-82fc670b35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.437306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb452ec-bcf0-4fba-8879-82fc670b35ff None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.437597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb452ec-bcf0-4fba-8879-82fc670b35ff None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.439132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb452ec-bcf0-4fba-8879-82fc670b35ff None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.440191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb452ec-bcf0-4fba-8879-82fc670b35ff None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.441730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb452ec-bcf0-4fba-8879-82fc670b35ff None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.445701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 227/433] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:01.445701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536d08-c323-4f6f-b6ea-7cca88c366f3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.445701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536d08-c323-4f6f-b6ea-7cca88c366f3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.445701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536d08-c323-4f6f-b6ea-7cca88c366f3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.450595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 228/434] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:01.453022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536d08-c323-4f6f-b6ea-7cca88c366f3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.481096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd2e14-7934-4e5b-a1a2-ac9be244552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.481867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd2e14-7934-4e5b-a1a2-ac9be244552a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.482196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd2e14-7934-4e5b-a1a2-ac9be244552a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.482849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd2e14-7934-4e5b-a1a2-ac9be244552a None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.487508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd2e14-7934-4e5b-a1a2-ac9be244552a None admin] RBAC: Adding query filter params (name=member) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:01.487508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd2e14-7934-4e5b-a1a2-ac9be244552a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.487508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd2e14-7934-4e5b-a1a2-ac9be244552a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.498205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 207/435] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:01.499603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1d4f3-ac61-419f-b18e-5e749f22b759 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.499896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1d4f3-ac61-419f-b18e-5e749f22b759 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.500167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1d4f3-ac61-419f-b18e-5e749f22b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.523127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c6c1d4f3-ac61-419f-b18e-5e749f22b759 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:01.524675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c6c1d4f3-ac61-419f-b18e-5e749f22b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:01.572217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536d08-c323-4f6f-b6ea-7cca88c366f3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.602665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 208/436] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:01.603680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1d4f3-ac61-419f-b18e-5e749f22b759 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.625036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.625698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.625989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.626272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.632742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=e9470df72a334ba29e4da06067e1d428) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:01.632742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.632742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.639175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 229/437] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=e9470df72a334ba29e4da06067e1d428&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:01.640217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.696302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.746371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.755383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1d4f3-ac61-419f-b18e-5e749f22b759 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.767032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb548b2-9785-4aba-8137-c14381f09b68 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:01.805540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac169c3-d165-47ed-9335-7bc4b5d7a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.807751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:01.807875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac169c3-d165-47ed-9335-7bc4b5d7a164 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.807875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac169c3-d165-47ed-9335-7bc4b5d7a164 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.807875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac169c3-d165-47ed-9335-7bc4b5d7a164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.808073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:01.808073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:01.808073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:01.825191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:01.834047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:01.835212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:01.836225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 230/438] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:01.843942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:01.902324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac169c3-d165-47ed-9335-7bc4b5d7a164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:01.903827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac169c3-d165-47ed-9335-7bc4b5d7a164 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:01.967794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:01.971609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051fe8-3f5c-4074-aaca-487959222caf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.016427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bfe3f-2b8d-4dd4-be0c-3cf72ecaea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.017016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bfe3f-2b8d-4dd4-be0c-3cf72ecaea89 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.017650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bfe3f-2b8d-4dd4-be0c-3cf72ecaea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.017650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bfe3f-2b8d-4dd4-be0c-3cf72ecaea89 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.018302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bfe3f-2b8d-4dd4-be0c-3cf72ecaea89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:02.020494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bfe3f-2b8d-4dd4-be0c-3cf72ecaea89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.020494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bfe3f-2b8d-4dd4-be0c-3cf72ecaea89 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.029669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.032008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 231/439] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:02.033290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1513db-dff6-4607-8c5d-7b83d853ef57 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.034048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1513db-dff6-4607-8c5d-7b83d853ef57 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.034327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1513db-dff6-4607-8c5d-7b83d853ef57 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.035897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 232/440] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:02.039675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 209/441] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:02.045186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1513db-dff6-4607-8c5d-7b83d853ef57 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.045312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab876d3-a3bd-4dd2-b4b2-f916fc4a8500 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.045312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab876d3-a3bd-4dd2-b4b2-f916fc4a8500 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.045312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab876d3-a3bd-4dd2-b4b2-f916fc4a8500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.062148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1ab876d3-a3bd-4dd2-b4b2-f916fc4a8500 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:02.063442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1ab876d3-a3bd-4dd2-b4b2-f916fc4a8500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:02.131254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 210/442] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:02.132086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab876d3-a3bd-4dd2-b4b2-f916fc4a8500 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.152747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1513db-dff6-4607-8c5d-7b83d853ef57 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.187566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.188210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.188498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.188779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.217532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.229012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab876d3-a3bd-4dd2-b4b2-f916fc4a8500 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.256221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.257664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.259182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.271363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.271363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.271363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.271363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.271799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.272981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.274682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 211/443] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:02.275480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.370542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 233/444] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:02.371436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.378314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c725693-c13b-4ad2-8ccf-8814290b783a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.411796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.412612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.412903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.413187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.424098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:02.431086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:02.431657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:02.432552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:02.433339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 212/445] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:02.434012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.480766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a61fa-14eb-42a5-abaf-0f1bae762639 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.489380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.513451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.514298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.514583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.514881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.516040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.517577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.519215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 234/446] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:02.519971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.532372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcb231-63ae-4e2f-9eb0-726d74b4b798 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.565957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.566811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.567128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.567406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] PATH_INFO: `/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.568582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=9b24f237e88b4ae0ae0f2b490dbacaca)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.570020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.571718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 213/447] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/projects/9b24f237e88b4ae0ae0f2b490dbacaca => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:02.580424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.632213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdaa6b-4874-4e90-9643-f96e34feb5ca None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.660548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.665843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.666504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.666786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.667093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.667835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:02.668142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.669562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.678129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 235/448] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:02.678817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.688077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5042e-e15f-4b84-a57c-f415947be4f7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.710267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.722176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.722816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.723160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.723443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.724284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=3fdad772aeff41e29a0619cd969d9f72, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:02.724601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.726038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.731754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 214/449] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=3fdad772aeff41e29a0619cd969d9f72 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:02.733183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.785355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3b517-a731-40fb-ac22-dea0a578f981 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.830497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.831677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.831790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.832004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] PATH_INFO: `/v3/groups/0a45b22075184f889470a50cb858a49e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.833386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] RBAC: Authorizing `identity:get_group(group_id=0a45b22075184f889470a50cb858a49e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.834849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:02.836693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 236/450] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/groups/0a45b22075184f889470a50cb858a49e => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:02.843428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:02.856975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3da7-29f8-4b98-b503-8bcefd06c11e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.897517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:02.898175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:02.898469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:02.898747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:02.913550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.960211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:02.961530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639117b-72b8-4cc4-83a9-43f6e4a94c2b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:02.974444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:02.976093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.000423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.001084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.001374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.001656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.002492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] RBAC: Adding query filter params (group.id=0a45b22075184f889470a50cb858a49e, role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:03.002916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.004620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.014947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 237/451] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/role_assignments?group.id=0a45b22075184f889470a50cb858a49e&scope.project.id=9b24f237e88b4ae0ae0f2b490dbacaca&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:03.092680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 215/452] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:03.098142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.206326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48901e-e6ca-4845-a509-3d9e2bf27d6d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.229116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:03.239712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.240573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.240858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.241132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] PATH_INFO: `/v3/projects/220b7f5f59544863b1dda75a37a7b01f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.242315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] RBAC: Authorizing `identity:get_project(project_id=220b7f5f59544863b1dda75a37a7b01f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.244311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.245598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 238/453] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:49:03 2022] GET /identity/v3/projects/220b7f5f59544863b1dda75a37a7b01f => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:03.251874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.337748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:03.353517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4b38e-4f32-441f-81bf-7276d94cfc28 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.389331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1d35a-ae28-47a2-8849-9bc731f21042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.390183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d35a-ae28-47a2-8849-9bc731f21042 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.390491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d35a-ae28-47a2-8849-9bc731f21042 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.390769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1d35a-ae28-47a2-8849-9bc731f21042 None admin] PATH_INFO: `/v3/groups/156819c72cb94d6c8286d414555d8d6d` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.391964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1d35a-ae28-47a2-8849-9bc731f21042 None admin] RBAC: Authorizing `identity:get_group(group_id=156819c72cb94d6c8286d414555d8d6d)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.393414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1d35a-ae28-47a2-8849-9bc731f21042 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.395060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 216/454] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 22 08:49:03 2022] GET /identity/v3/groups/156819c72cb94d6c8286d414555d8d6d => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:03.400759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:03.496966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ecc35-c8d8-4294-bed7-a44e627100fd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:03.529590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d3bdf-fdd2-41f2-8b5a-c7bf0d440422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:03.530223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3bdf-fdd2-41f2-8b5a-c7bf0d440422 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:03.530510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3bdf-fdd2-41f2-8b5a-c7bf0d440422 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:03.530792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3bdf-fdd2-41f2-8b5a-c7bf0d440422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:03.531650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d3bdf-fdd2-41f2-8b5a-c7bf0d440422 None admin] RBAC: Adding query filter params (group.id=156819c72cb94d6c8286d414555d8d6d, role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=220b7f5f59544863b1dda75a37a7b01f) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:03.531965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d3bdf-fdd2-41f2-8b5a-c7bf0d440422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:03.533380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d3bdf-fdd2-41f2-8b5a-c7bf0d440422 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:03.539078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 239/455] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 22 08:49:03 2022] GET /identity/v3/role_assignments?group.id=156819c72cb94d6c8286d414555d8d6d&scope.project.id=220b7f5f59544863b1dda75a37a7b01f&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:05.974295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584cf71-ba38-4e3c-a5ef-316f66b64e4d None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:05.974859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584cf71-ba38-4e3c-a5ef-316f66b64e4d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:05.974859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584cf71-ba38-4e3c-a5ef-316f66b64e4d None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:05.976507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 217/456] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:05.981674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49b453-548a-44fd-809f-698e24ac4f68 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:05.982103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49b453-548a-44fd-809f-698e24ac4f68 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:05.982291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49b453-548a-44fd-809f-698e24ac4f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:05.999512 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-1a49b453-548a-44fd-809f-698e24ac4f68 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.000689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1a49b453-548a-44fd-809f-698e24ac4f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.052918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:06.069454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 240/457] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:06.095749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584cf71-ba38-4e3c-a5ef-316f66b64e4d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.236819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584cf71-ba38-4e3c-a5ef-316f66b64e4d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:06.280858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c215cbb-deb6-46d8-808b-e90c514e3726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:06.281648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c215cbb-deb6-46d8-808b-e90c514e3726 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.281928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c215cbb-deb6-46d8-808b-e90c514e3726 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.282204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c215cbb-deb6-46d8-808b-e90c514e3726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.298461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c215cbb-deb6-46d8-808b-e90c514e3726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:06.299940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c215cbb-deb6-46d8-808b-e90c514e3726 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-9c215cbb-deb6-46d8-808b-e90c514e3726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:06.321582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:06.322490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:06.323342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:06.323342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:06.323342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:06.323342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:06.327163 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 218/458] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:06.331923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49b453-548a-44fd-809f-698e24ac4f68 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.473056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fd2b-20a3-41da-a1f3-d37eaecbe70e None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.473376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fd2b-20a3-41da-a1f3-d37eaecbe70e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.473607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fd2b-20a3-41da-a1f3-d37eaecbe70e None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.476166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 219/459] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:49:06.481092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b560-d3f2-466b-bf97-9cb4e38812a4 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.481377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b560-d3f2-466b-bf97-9cb4e38812a4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.481656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b560-d3f2-466b-bf97-9cb4e38812a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.503310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:06.515373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a5c0b560-d3f2-466b-bf97-9cb4e38812a4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.518117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a5c0b560-d3f2-466b-bf97-9cb4e38812a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.523433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49b453-548a-44fd-809f-698e24ac4f68 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:06.565434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991623d-7224-453d-ab7a-c7b52c091221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:06.566551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991623d-7224-453d-ab7a-c7b52c091221 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.567068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991623d-7224-453d-ab7a-c7b52c091221 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.567559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991623d-7224-453d-ab7a-c7b52c091221 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.568497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991623d-7224-453d-ab7a-c7b52c091221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:06.569001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991623d-7224-453d-ab7a-c7b52c091221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:06.570577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991623d-7224-453d-ab7a-c7b52c091221 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:06.583263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 241/460] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:06.584962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45b9d-53cc-4069-8391-49eea8a542a8 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.585452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45b9d-53cc-4069-8391-49eea8a542a8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.585928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45b9d-53cc-4069-8391-49eea8a542a8 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.587637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 242/461] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:06.593097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76969e-7c3a-437b-835a-9b73ac8d0dfa None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.593602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76969e-7c3a-437b-835a-9b73ac8d0dfa None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.594081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76969e-7c3a-437b-835a-9b73ac8d0dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.610917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 220/462] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:49:06.612289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b560-d3f2-466b-bf97-9cb4e38812a4 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.620444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-fa76969e-7c3a-437b-835a-9b73ac8d0dfa None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.621838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fa76969e-7c3a-437b-835a-9b73ac8d0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.687026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:06.721524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 243/463] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:49:06.722450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76969e-7c3a-437b-835a-9b73ac8d0dfa None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.741503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b560-d3f2-466b-bf97-9cb4e38812a4 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:06.777807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada8e17-5e5c-41ee-8e27-d6528563d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:06.778396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada8e17-5e5c-41ee-8e27-d6528563d05a None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.778695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada8e17-5e5c-41ee-8e27-d6528563d05a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.779531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada8e17-5e5c-41ee-8e27-d6528563d05a None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.780353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada8e17-5e5c-41ee-8e27-d6528563d05a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:06.781783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada8e17-5e5c-41ee-8e27-d6528563d05a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:06.789688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:06.827204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76969e-7c3a-437b-835a-9b73ac8d0dfa None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:06.860910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10720a-6a26-4f86-bb4d-38e876213f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:06.861966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10720a-6a26-4f86-bb4d-38e876213f94 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.862247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10720a-6a26-4f86-bb4d-38e876213f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.862522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10720a-6a26-4f86-bb4d-38e876213f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.872513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10720a-6a26-4f86-bb4d-38e876213f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:06.873961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10720a-6a26-4f86-bb4d-38e876213f94 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:06.885035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 221/464] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/users => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:06.885035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f7ff0-24ce-4641-bcd6-c5622c15f7d1 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.885035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f7ff0-24ce-4641-bcd6-c5622c15f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.885035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f7ff0-24ce-4641-bcd6-c5622c15f7d1 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.885388 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 222/465] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:06.887981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f7ff0-24ce-4641-bcd6-c5622c15f7d1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-dc10720a-6a26-4f86-bb4d-38e876213f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:06.904698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:06.913014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 244/466] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e67140-aeaf-4d74-b2c4-045198858521 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e67140-aeaf-4d74-b2c4-045198858521 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:06.913906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e67140-aeaf-4d74-b2c4-045198858521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:06.933082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-57e67140-aeaf-4d74-b2c4-045198858521 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:06.934801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-57e67140-aeaf-4d74-b2c4-045198858521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:06.963385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.016492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 245/467] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:07.018319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e67140-aeaf-4d74-b2c4-045198858521 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.028871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f7ff0-24ce-4641-bcd6-c5622c15f7d1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.074206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.075323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.076490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.076837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.088958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.090433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:07.110118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:07.111445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:07.112307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:07.112307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:07.112307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:07.112307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:07.112517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 223/468] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:07.113775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.157919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e67140-aeaf-4d74-b2c4-045198858521 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.171330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.199108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.199779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.200066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.200346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.201729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:07.202241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.204268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.218891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 246/469] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:07.219727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.243325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecadb7-ac91-4f34-9142-8ed6148e107e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.244903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.280657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.281350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.281636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.281914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.293360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.295555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:07.313787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:07.314787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:07.315657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:07.315657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:07.315657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:07.315657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:07.315657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 224/470] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:07.315930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.347468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d351-f104-400f-ae24-2e7192109a7f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.385737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.386400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.386687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.386999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.387718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:07.388048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.389435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.401146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 247/471] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:07.401758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.429931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.434800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f25d-f3cd-472c-a0ec-c9e9fad83c7a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.473159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.473836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.474124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.474408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.475156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.476596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.487706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.508810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64a525-c79a-4bc1-9184-5f238a839288 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.541162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c6e15-d557-4791-9768-7c1e0cba42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.541762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6e15-d557-4791-9768-7c1e0cba42dc None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.542049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6e15-d557-4791-9768-7c1e0cba42dc None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.542329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6e15-d557-4791-9768-7c1e0cba42dc None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.543080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6e15-d557-4791-9768-7c1e0cba42dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:07.543387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6e15-d557-4791-9768-7c1e0cba42dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.545323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6e15-d557-4791-9768-7c1e0cba42dc None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.556709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 248/472] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:07.558002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fece0e-2c6f-447f-8ba2-0361c8689c86 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.558295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fece0e-2c6f-447f-8ba2-0361c8689c86 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.558577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fece0e-2c6f-447f-8ba2-0361c8689c86 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.562972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 249/473] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:07.569757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fece0e-2c6f-447f-8ba2-0361c8689c86 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.582434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 225/474] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:07.583388 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:07.715562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fece0e-2c6f-447f-8ba2-0361c8689c86 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.721723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f73424-316f-4038-a3d7-daace00fc950 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:07.755903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df1b31-fd18-46c5-b7b9-a6a2ed62bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.756578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1b31-fd18-46c5-b7b9-a6a2ed62bf17 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.756861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1b31-fd18-46c5-b7b9-a6a2ed62bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.757142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1b31-fd18-46c5-b7b9-a6a2ed62bf17 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.757840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df1b31-fd18-46c5-b7b9-a6a2ed62bf17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.759396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df1b31-fd18-46c5-b7b9-a6a2ed62bf17 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.767566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:07.768956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.769588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.770387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:07.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.771768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:07.773486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:07.896207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 250/476] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/users => generated 248 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:07.896572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 226/476] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/users => generated 249 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:07.902897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45dce-30ab-4dcc-85f6-ce6561642aff None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:07.902897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45dce-30ab-4dcc-85f6-ce6561642aff None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:07.902897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f45dce-30ab-4dcc-85f6-ce6561642aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:07.930605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-95f45dce-30ab-4dcc-85f6-ce6561642aff None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:07.931938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-95f45dce-30ab-4dcc-85f6-ce6561642aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:08.031880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 251/477] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:08.067611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.085745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.199171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69fb97-69ee-421c-81e8-535e50d01e51 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.241597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.242647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.243169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.243646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.244722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.246302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.323819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.sql.core [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:49:08.323819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 08:49:08.323819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [parameters: {'id': '63febf777a1a49e9b9debd5d985689ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 08:49:08.323819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80551) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application result.read() Jun 22 08:49:08.344523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:49:08.345636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application yield resource Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise self.value Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application session.commit() Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:49:08.346798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:49:08.347901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:49:08.348964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application result.read() Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:49:08.349958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [parameters: {'id': '63febf777a1a49e9b9debd5d985689ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:08.350963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 08:49:08.357654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:08.358791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 227/478] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 22 08:49:08 2022] POST /identity/v3/roles => generated 144 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:08.362957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45dce-30ab-4dcc-85f6-ce6561642aff None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.475286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f45dce-30ab-4dcc-85f6-ce6561642aff None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.501119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.514920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117d6c4-3408-4b46-8eb3-46ae9ef24193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.516873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d6c4-3408-4b46-8eb3-46ae9ef24193 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.516873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d6c4-3408-4b46-8eb3-46ae9ef24193 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.516873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d6c4-3408-4b46-8eb3-46ae9ef24193 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.529122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117d6c4-3408-4b46-8eb3-46ae9ef24193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2117d6c4-3408-4b46-8eb3-46ae9ef24193 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:08.542981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:08.543940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:49:08.544867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:08.547672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 252/479] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:08.553179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:08.668418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:08.711326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cf802-ceb2-4697-8c60-05e7389ee6b0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:08.755263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae1f80-6cb1-4f08-a621-9e1c97ce3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:08.755860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1f80-6cb1-4f08-a621-9e1c97ce3e39 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:08.756151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1f80-6cb1-4f08-a621-9e1c97ce3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:08.756436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1f80-6cb1-4f08-a621-9e1c97ce3e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:08.757201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae1f80-6cb1-4f08-a621-9e1c97ce3e39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:08.757513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae1f80-6cb1-4f08-a621-9e1c97ce3e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:08.758911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae1f80-6cb1-4f08-a621-9e1c97ce3e39 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:08.771030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 228/480] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:09.212648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12479b-5d5d-4b0f-9742-e6a3381a42e7 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.213648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12479b-5d5d-4b0f-9742-e6a3381a42e7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.214162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12479b-5d5d-4b0f-9742-e6a3381a42e7 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.215753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 253/481] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:09.222271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694974ae-ee32-4b3b-9a9a-426154dc3938 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.223105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694974ae-ee32-4b3b-9a9a-426154dc3938 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.223600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694974ae-ee32-4b3b-9a9a-426154dc3938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.241910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-694974ae-ee32-4b3b-9a9a-426154dc3938 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:09.243384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-694974ae-ee32-4b3b-9a9a-426154dc3938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:09.318845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 229/482] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:09.342979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12479b-5d5d-4b0f-9742-e6a3381a42e7 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.499606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12479b-5d5d-4b0f-9742-e6a3381a42e7 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.548268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.549444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.549982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.550445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.568502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:09.576463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:09.577326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:09.578125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:09.583685 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 254/483] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:09.586929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694974ae-ee32-4b3b-9a9a-426154dc3938 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.651623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:09.691580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694974ae-ee32-4b3b-9a9a-426154dc3938 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.734691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.735742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.736474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.736944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.737910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:09.738410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.739981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.749261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 230/484] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:09.755732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:09.820172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:09.886850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cb86c-7fb6-45f2-aecf-20b11ea0f1fa None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:09.933323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb50e13-cb6d-409a-8341-20c4545c2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:09.934121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50e13-cb6d-409a-8341-20c4545c2b1a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:09.934406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50e13-cb6d-409a-8341-20c4545c2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:09.934681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb50e13-cb6d-409a-8341-20c4545c2b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:09.948332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb50e13-cb6d-409a-8341-20c4545c2b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:09.949787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb50e13-cb6d-409a-8341-20c4545c2b1a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-0fb50e13-cb6d-409a-8341-20c4545c2b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:09.972709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:09.973619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:09.974453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:09.974453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:09.974453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:09.974453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:09.978424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 255/485] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:09.983904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.106133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6ca9-9be4-4db8-b971-f8c5288c73bc None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.131427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64b0b-17ec-4151-9383-56776eb0e874 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.131756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64b0b-17ec-4151-9383-56776eb0e874 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.131980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b64b0b-17ec-4151-9383-56776eb0e874 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.133316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 256/486] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:49:10.138680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b89c-50bd-4288-b6df-8e9f35e8763f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.138944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b89c-50bd-4288-b6df-8e9f35e8763f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.139172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b89c-50bd-4288-b6df-8e9f35e8763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.143183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.154687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.155373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.155656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.155926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.156655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:10.156960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.158311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.165173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ac91b89c-50bd-4288-b6df-8e9f35e8763f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:10.167522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ac91b89c-50bd-4288-b6df-8e9f35e8763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.191006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 231/487] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:10.194039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.314986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 257/488] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:10.352642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b89c-50bd-4288-b6df-8e9f35e8763f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.354054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98abbe2-2d04-4a56-b991-4126a589f372 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.395525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.396428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.396711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.396984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.405177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.406624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.416965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:10.422851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:10.423768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:10.424678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:10.428601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 232/489] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:10.430146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.479218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.503396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b89c-50bd-4288-b6df-8e9f35e8763f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.533156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8dc6c-8425-42e5-ad2c-8689effeddfb None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.539524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83720c-c74d-4408-9553-cc27ab1463d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.540330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83720c-c74d-4408-9553-cc27ab1463d2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.540624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83720c-c74d-4408-9553-cc27ab1463d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.540912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83720c-c74d-4408-9553-cc27ab1463d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.552186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83720c-c74d-4408-9553-cc27ab1463d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9c83720c-c74d-4408-9553-cc27ab1463d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:10.563823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:10.564725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:10.565575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:10.566178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 258/490] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:10.567684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b4bc-6cb1-4fe0-b847-fd099c37f9be None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.567684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b4bc-6cb1-4fe0-b847-fd099c37f9be None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.567991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b4bc-6cb1-4fe0-b847-fd099c37f9be None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.569879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9b8d7-0d04-44e9-aa3a-2cd31058024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.570761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b8d7-0d04-44e9-aa3a-2cd31058024c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.571121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b8d7-0d04-44e9-aa3a-2cd31058024c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.571436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b8d7-0d04-44e9-aa3a-2cd31058024c None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.572282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b8d7-0d04-44e9-aa3a-2cd31058024c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:10.573222 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b8d7-0d04-44e9-aa3a-2cd31058024c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.573394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 259/491] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:10.573959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462b4bc-6cb1-4fe0-b847-fd099c37f9be None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.574707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b8d7-0d04-44e9-aa3a-2cd31058024c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.616288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 233/492] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:10.616288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07de1f-b366-41f6-b1c8-6d588346b82d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.616747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07de1f-b366-41f6-b1c8-6d588346b82d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.616912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07de1f-b366-41f6-b1c8-6d588346b82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.634867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1b07de1f-b366-41f6-b1c8-6d588346b82d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:10.636084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1b07de1f-b366-41f6-b1c8-6d588346b82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.674698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.693846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462b4bc-6cb1-4fe0-b847-fd099c37f9be None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.722845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 234/493] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:10.722845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb001-4a13-41e9-9f2d-d266af844671 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.722845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb001-4a13-41e9-9f2d-d266af844671 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.722845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb001-4a13-41e9-9f2d-d266af844671 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.722845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 235/494] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:10.722845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb001-4a13-41e9-9f2d-d266af844671 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.731996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a5add-591c-4122-9554-442601724c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.732660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a5add-591c-4122-9554-442601724c63 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.733462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a5add-591c-4122-9554-442601724c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.733746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a5add-591c-4122-9554-442601724c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.734498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a5add-591c-4122-9554-442601724c63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:10.734805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a5add-591c-4122-9554-442601724c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.737360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a5add-591c-4122-9554-442601724c63 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.748546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 260/495] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:10.750446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83a5a-8614-49db-ac46-fd4e58f46ef9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.750744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83a5a-8614-49db-ac46-fd4e58f46ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.751075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83a5a-8614-49db-ac46-fd4e58f46ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.762700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.770195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ceb83a5a-8614-49db-ac46-fd4e58f46ef9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:10.771131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ceb83a5a-8614-49db-ac46-fd4e58f46ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:10.832263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb001-4a13-41e9-9f2d-d266af844671 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.844103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 261/496] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:10.855005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb83a5a-8614-49db-ac46-fd4e58f46ef9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:10.878018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.878677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.879052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.879330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:10.933717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.949709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:10.951860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:10.955915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb83a5a-8614-49db-ac46-fd4e58f46ef9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:10.983959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:10.994291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:10.995108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:10.995608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:10.995836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.008810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:11.017055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:11.017950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:11.018756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 262/497] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:11.020120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.056128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 236/498] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:11.057381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.128340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86359-0524-47b4-a604-1e038375659f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.161399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.162212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.162479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.162763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.165019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3d618-0ac4-497d-9425-8e7592373190 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.169782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.173954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.175461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:11.192918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:11.194011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:11.195171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:11.195171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:11.195171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.195171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:11.195761 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 263/499] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:11.196535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.211141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.212092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.212382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.213034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.215547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.225634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:11.233938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:11.234795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 237/500] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:11.240998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.303979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcbd1-fa80-4e92-8bd0-e29cb4543333 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.339644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.340397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.340640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.340867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.341637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:11.342001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.342717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6405-5bfe-444a-a088-f91529ef2a7e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.343440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.359185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 264/501] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:11.359185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.386387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.387128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.387408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.387684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.398332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.399991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.417067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:11.422687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:11.423571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:11.424431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:11.424431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:11.424431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.424431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:11.424431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 238/502] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:11.425319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.472553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c039c-5ff1-4b44-8804-822cae404dda None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.473377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.508586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.509573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.510037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.510491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.511434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:11.511915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.514079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.527191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 265/503] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:11.528278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.533113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126d4f-9a8c-43fa-b123-cc6a06d4ea50 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.571032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.571861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.572145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.572471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.573224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:11.573668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.575244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.584643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 239/504] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:11.585731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.639935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bebba-25f4-430c-9723-4e5ce0308d84 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.653271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.673089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.673867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.674151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.674427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.684068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.685805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2c1d2-4f35-4257-b76d-37051865cb96 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.686070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.694349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:11.703729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:11.704594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:11.705879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:11.705879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:11.705879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.705879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:11.706275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 266/505] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:11.707401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.719103 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.719757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.720038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.720314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.721033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:11.721338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.722781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.735680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 240/506] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:11.736748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.804543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bf7cf-9478-4e18-88c0-4b77f90ff6e7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.837411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086c36b-7d28-4527-a44b-cb5ef832ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.837793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8763e-7514-47a2-8909-a200fd465199 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:11.838439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c36b-7d28-4527-a44b-cb5ef832ccff None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.838719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c36b-7d28-4527-a44b-cb5ef832ccff None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.839019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c36b-7d28-4527-a44b-cb5ef832ccff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.845743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086c36b-7d28-4527-a44b-cb5ef832ccff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.847192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086c36b-7d28-4527-a44b-cb5ef832ccff None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c086c36b-7d28-4527-a44b-cb5ef832ccff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:11.863234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:11.864303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:11.865527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 267/507] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:11.866230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35c34-acc7-4eb8-a908-0e3b889a3568 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.866230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35c34-acc7-4eb8-a908-0e3b889a3568 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.866230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35c34-acc7-4eb8-a908-0e3b889a3568 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.867568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 268/508] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:11.868135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35c34-acc7-4eb8-a908-0e3b889a3568 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.878173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:11.878997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:11.879281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:11.879553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:11.890482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:11.891903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:11.892373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:11.908958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:11.909940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:11.910788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:11.910788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:11.910788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:11.910788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:11.910788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 241/509] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:11.911088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:11.932389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:11.967818 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35c34-acc7-4eb8-a908-0e3b889a3568 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.001740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.002398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.002687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.002999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.003722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:12.004029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.005410 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.008311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c92235-d936-4acf-b820-743cdf486385 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.016279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 269/510] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:12.017065 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.041903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57f28a-6bf0-4a38-a32b-3ba2f865580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.042697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f28a-6bf0-4a38-a32b-3ba2f865580c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.043007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f28a-6bf0-4a38-a32b-3ba2f865580c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.043284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f28a-6bf0-4a38-a32b-3ba2f865580c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.050317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57f28a-6bf0-4a38-a32b-3ba2f865580c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.051785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57f28a-6bf0-4a38-a32b-3ba2f865580c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-4d57f28a-6bf0-4a38-a32b-3ba2f865580c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:12.066246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:12.067309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:12.068420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 242/511] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:12.068896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6766-9f37-47d2-bbfe-1699bfd186db None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.069207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6766-9f37-47d2-bbfe-1699bfd186db None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.069438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6766-9f37-47d2-bbfe-1699bfd186db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.085108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e7de6766-9f37-47d2-bbfe-1699bfd186db None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:12.086336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e7de6766-9f37-47d2-bbfe-1699bfd186db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:12.100881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.116904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b7640-b9aa-4843-836f-521010dd848f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.150253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.150758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 243/512] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:12.150970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.151144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.151417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.151595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6766-9f37-47d2-bbfe-1699bfd186db None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.152322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:12.152634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.154595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.168808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.192190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 270/513] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:12.193016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.255940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6766-9f37-47d2-bbfe-1699bfd186db None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.288426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.288957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda405-0394-4dd0-a753-459c6c709038 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.289059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.289345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.289617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.290325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:12.290627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.292022 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.303758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 244/514] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:12.304453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.327217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.327994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.328281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.328561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.335454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.336890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:12.351328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:12.352690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:49:12.353764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:12.358005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 271/515] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:12.358253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.361295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.372751 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.403315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fac79-bdb8-43d5-aa86-e4d9fa1d515e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.436358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.437005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.437295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.437557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.438333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:12.438640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.440097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.457262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 245/516] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:12.457887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.460497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5633d1-4a9f-4c98-b552-671f3c9762c6 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.495497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.496275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.496555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.496826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.508537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.509960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:12.526339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:12.527451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:12.528344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:12.528344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:12.528344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:12.528344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:12.528344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 272/517] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:12.529130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.561346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7d466-1193-4f5c-b069-412b0a2f311f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.585499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.589767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.596119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.596770 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.597056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.597338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.629260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465fdf8-6e4d-4b15-9939-fa671ecec34f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.662574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.662854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.663646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.663939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.664045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.664222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.671706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.673119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:12.686765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:12.687852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 273/518] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:12.689055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.766777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 246/519] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:12.767653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.787611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2f064-c6e5-4428-a0ce-b3917c5804a4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.796291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.801171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:12.820282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.820952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.821240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.821520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.822351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:12.822661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.824114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.841890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 274/520] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:12.842738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.865217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d189-3add-42d5-8497-f6be8ffd15f2 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.898252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.898922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:12.899207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:12.899479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:12.900306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=4c0cbf8022ee4c37a591ee578b53806c) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:12.900615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:12.902057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:12.908042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 247/521] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/role_assignments?user.id=4c0cbf8022ee4c37a591ee578b53806c&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:12.908812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:12.959352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522c9c-8bc8-410e-84ce-230258fb6b7a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:12.998929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:12.999726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.000010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.000425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.001135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:13.001440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.002869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.010075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.016288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 275/522] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:13.018515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca6a5e-9726-4522-9a78-562bcaf6fb3a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.025324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.053915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.057087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.057767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.058057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.058334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.059218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:13.061041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.061496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.082715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 248/523] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 22 08:49:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:13.083614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.134249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b11b5-af05-4bd9-891c-95412bd8a661 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.170574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.171547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.171842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.172119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.182685 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.183078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3e81-507f-4e4f-a9b5-208eb8f5d226 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.184149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:13.203769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:13.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:13.205851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:13.205851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:13.205851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:13.205851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:13.205851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 276/524] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:13.206147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.223557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.224144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.224405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.224682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.248624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.290991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.301689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.303180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.306902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578025-93f2-4b0b-84e9-e7261ca460c7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.342280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.342993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.343269 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.343548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.344245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.345677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.404201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 249/525] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:13.405050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.459667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.461066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 277/526] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:49:13 2022] POST /identity/v3/users => generated 247 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:13.462441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.535834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214029-79e2-45fc-ac89-ddec6b03d569 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.583082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.583860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.584218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.584840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.594487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e536-8551-4ab8-bc51-a69f2db72bbf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.635777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.636455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.636782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.637068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.638016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:13.638209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.639775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.649343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.654869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 278/527] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:13.655510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.678842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.680335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.745708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.770454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ad34f-1bc3-4f98-9919-c09c25365b1e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.804557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 250/528] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:13.805639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.818967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.819776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.820069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.820604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.833284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.835364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:13.858811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:13.859737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:13.860595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:13.860595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:13.860595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:13.860595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:13.860595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 279/529] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:13.861442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:13.931538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168acf7-0455-4f1f-82d1-a8401d417da9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.932690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:13.976724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:13.978398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:13.979115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:13.979545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:13.990242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:13.991729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a48f8-d589-4512-85de-f46c65bd2078 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:13.992205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:14.012733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:14.013814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:14.014858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:14.017192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 251/530] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:14.018233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.027260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.028141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.029023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.029370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.037400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.041346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.042961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:14.062320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:14.063435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:14.064408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:14.064408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:14.064408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:14.064408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:14.064837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 280/531] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:14.065742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.141395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e2a9-a24f-481f-8dad-c7e740a72e5e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.167385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13366-fcbd-4391-8216-aaee46e137ee None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.169816 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.180774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.181677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.191396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.191396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.191396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:14.191396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.191396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.197492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 252/532] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:14.198704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.201836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.202855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.203105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.203385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.204942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:14.204942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.205949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.224921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 281/533] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:14.225772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.281350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.314350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3689-f0b6-4d94-a516-20400e11f47e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.326690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dafa10-1a81-4d05-b8de-140583238aa0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.365270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.366206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.366736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.367315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.368374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:14.369016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.370058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.370850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.370981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.371139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.371413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.378196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.379653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.385630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 253/534] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:14.386713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:14.394551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:14.395625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:14.396631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:14.400242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 282/535] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:14.401058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.428562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.499752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef57a1-a0f1-4fec-bc4c-505e1604e35f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.504114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23236b2-8d6f-4272-be2f-6e97a757385d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.533423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.540690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.541833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.542357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.542780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.542913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.543750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.544117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.544279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=497a2c9e3fe04d9e85d513c9beb4f6bd) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:14.544381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.544829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.546707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.551633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.553323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.553484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 254/536] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/role_assignments?user.id=497a2c9e3fe04d9e85d513c9beb4f6bd&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:14.554694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:14.568988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:14.570070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:14.571189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:14.572555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 283/537] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:14.580181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.748078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19081590-b010-4740-8830-2157738fc2c5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.785810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.786473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.786754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.787055 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.787844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:14.788152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.789590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.799193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:14.814562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 255/538] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:14.821623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.823776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899beb-f359-4864-95fa-570cd5b403e9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:14.885910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:14.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:14.886883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:14.887301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:14.888124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:14.888431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:14.890097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:14.909304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 284/539] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:14.914723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:14.936219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:15.022895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74369b3-b753-4cc7-8aed-d8ddfd8805fa None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.086382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a8541-9c49-48b3-a37a-dfba340047fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:15.087158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8541-9c49-48b3-a37a-dfba340047fc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.087547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8541-9c49-48b3-a37a-dfba340047fc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.087920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8541-9c49-48b3-a37a-dfba340047fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.088874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8541-9c49-48b3-a37a-dfba340047fc None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=c6bbb0e4d7ca44fc8cb68fdc96260caa) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:15.089287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8541-9c49-48b3-a37a-dfba340047fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:15.089964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7905d6-1b00-4489-8740-9909b8633b6d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.090999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8541-9c49-48b3-a37a-dfba340047fc None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:15.100372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 256/540] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/role_assignments?user.id=c6bbb0e4d7ca44fc8cb68fdc96260caa&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:15.100372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920b68-9593-4de6-ab25-8b6af9786410 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.100372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920b68-9593-4de6-ab25-8b6af9786410 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.100372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920b68-9593-4de6-ab25-8b6af9786410 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.100372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 257/541] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:15.108398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd2dc-f01b-4b80-839e-32c4ddebe4f6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.108685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd2dc-f01b-4b80-839e-32c4ddebe4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.108968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd2dc-f01b-4b80-839e-32c4ddebe4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.143742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-48cbd2dc-f01b-4b80-839e-32c4ddebe4f6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:15.146158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-48cbd2dc-f01b-4b80-839e-32c4ddebe4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:15.168367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:15.169964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.170420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.170917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.174466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=99a49aca72844411b6bc1feff566cc7e) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:15.175040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:15.180000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:15.197127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 285/542] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:14 2022] GET /identity/v3/role_assignments?user.id=99a49aca72844411b6bc1feff566cc7e&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:15.263884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 258/543] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:15.290235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:15.326882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:15.410631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18aaa-8033-4077-996c-64afb12043b5 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.446070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:15.447047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.447433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.447833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.458509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:15.466882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:15.467958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:15.468934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:15.475047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 286/544] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:15.476906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbd2dc-f01b-4b80-839e-32c4ddebe4f6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:15.535600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:15.601783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbd2dc-f01b-4b80-839e-32c4ddebe4f6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.650010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af40f-eb6e-4c77-8b81-73b6dd18fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:15.650562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af40f-eb6e-4c77-8b81-73b6dd18fea7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.650866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af40f-eb6e-4c77-8b81-73b6dd18fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.651143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af40f-eb6e-4c77-8b81-73b6dd18fea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.651900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af40f-eb6e-4c77-8b81-73b6dd18fea7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:15.652206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af40f-eb6e-4c77-8b81-73b6dd18fea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:15.654141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af40f-eb6e-4c77-8b81-73b6dd18fea7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:15.662781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 259/545] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:15.668087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:15.749875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:15.754797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180583-9afa-42f7-bda0-85171634b3e5 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.755200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180583-9afa-42f7-bda0-85171634b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.755488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180583-9afa-42f7-bda0-85171634b3e5 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.757328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 260/546] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:15.767300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46bacc-db8f-461d-8de7-d4ab2e28e871 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.775457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46bacc-db8f-461d-8de7-d4ab2e28e871 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.775457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46bacc-db8f-461d-8de7-d4ab2e28e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.786245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cd6f2-ae1a-4f81-8221-a4ec68626c72 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.812021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-8a46bacc-db8f-461d-8de7-d4ab2e28e871 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:15.813266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8a46bacc-db8f-461d-8de7-d4ab2e28e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:15.828241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:15.829053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:15.829343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:15.829626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:15.843149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:15.844599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:15.861997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:15.862992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:15.864282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:15.864282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:15.864282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:15.864282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:15.864282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 287/547] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:15.868816 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:15.971380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7d8d-e235-47e2-b5c9-f758cdc04cda None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:15.992018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:16.006730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.009075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.009075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.009075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.009075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:16.009075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.010638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.021043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 261/548] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:49:16.023632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 288/549] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:16.029160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46bacc-db8f-461d-8de7-d4ab2e28e871 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.063921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.095543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:16.207268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31a0be-4c70-43f7-9fa4-d8a79028f8e2 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.216755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46bacc-db8f-461d-8de7-d4ab2e28e871 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.242107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.242904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.243194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.243476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.254935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:16.263483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:16.264392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:16.265346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 289/550] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:16.270477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.295603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.296409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.296691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.296964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.311178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.312656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:16.335239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:16.336346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:16.337250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 262/551] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:16.345399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.361275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:16.481059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215c356-ba43-4fd0-9895-a936f5b708a6 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.502960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4e860-3148-4f84-a86b-5dda9b86e5f6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.506377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:16.548014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.548693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.548977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.549253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.551740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:16.551740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.551740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.565376 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 290/552] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:16.572225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.577707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.578382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.578670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.579849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.580697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:16.581009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.585574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.617118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 263/553] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:16.623695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.763544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de923e1-9844-4b3a-8767-142e5e350cf4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.766170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:16.805150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705730-292b-4f80-8c2f-797042313e9c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:16.834315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07f825-6e2a-467f-8374-0f3fd8b75e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.835138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07f825-6e2a-467f-8374-0f3fd8b75e4e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.835426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07f825-6e2a-467f-8374-0f3fd8b75e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.835707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07f825-6e2a-467f-8374-0f3fd8b75e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.855205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07f825-6e2a-467f-8374-0f3fd8b75e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.856710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07f825-6e2a-467f-8374-0f3fd8b75e4e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.876264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bec02d-5110-4432-98e3-65f234082ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:16.877062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bec02d-5110-4432-98e3-65f234082ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.877347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bec02d-5110-4432-98e3-65f234082ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.877634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bec02d-5110-4432-98e3-65f234082ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.892495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bec02d-5110-4432-98e3-65f234082ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:16.894119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bec02d-5110-4432-98e3-65f234082ff8 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ee07f825-6e2a-467f-8374-0f3fd8b75e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:16.894234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:16.895298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:16.896368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:16.896368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:16.896368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:16.896368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:16.896368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 291/554] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:16.897088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb948b-1112-43f0-9099-ebb169a838ee None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.897387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb948b-1112-43f0-9099-ebb169a838ee None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.897693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb948b-1112-43f0-9099-ebb169a838ee None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.906650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 292/555] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:16.906650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb948b-1112-43f0-9099-ebb169a838ee None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-e9bec02d-5110-4432-98e3-65f234082ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:16.923335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:16.924415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:16.925990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:16.925990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:16.925990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:16.925990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:16.928280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 264/556] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:16.929638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a47ec-4360-41b9-8f3d-bd139b2abc42 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:16.930058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a47ec-4360-41b9-8f3d-bd139b2abc42 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:16.930470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a47ec-4360-41b9-8f3d-bd139b2abc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:16.951247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-877a47ec-4360-41b9-8f3d-bd139b2abc42 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:16.952678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-877a47ec-4360-41b9-8f3d-bd139b2abc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:16.961743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.035350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb948b-1112-43f0-9099-ebb169a838ee None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.043140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 265/557] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:17.044732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a47ec-4360-41b9-8f3d-bd139b2abc42 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.076983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.077829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.078413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.078794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.080002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:17.080414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.081951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.098452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 293/558] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:17.099457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.125905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.191293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a47ec-4360-41b9-8f3d-bd139b2abc42 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.221057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1a04-8569-48c1-a4d0-8d530e6f90c7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.244130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.245141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.245495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.245845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.247478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:17.248306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.250036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.263962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 266/559] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:17.265038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.268062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.268207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.270750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.272433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.272792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.287829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:17.299146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:17.300078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:17.300930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:17.302894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 294/560] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:17.303918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.394220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30075402-ba23-4299-996d-0b7c5f3a440d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.407088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.433250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.434435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.434973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.435483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.444362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.444877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afdcde-5d97-4e97-bb62-f11a2fcde81b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.446379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:17.461058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:17.462124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:17.463501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:17.465522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 267/561] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:17.467088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.492140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.493467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.493764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.494095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.504190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.505639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:17.520884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:17.521772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:17.522658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:17.526705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 295/562] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:17.527606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.536650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.576319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db670a9-ea07-4574-ab90-6b20a241b9df None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.613635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afa75d-8adc-4867-a073-2f6a50f6ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.614318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afa75d-8adc-4867-a073-2f6a50f6ae5f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.614807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afa75d-8adc-4867-a073-2f6a50f6ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.614955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afa75d-8adc-4867-a073-2f6a50f6ae5f None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.615622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afa75d-8adc-4867-a073-2f6a50f6ae5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:17.615933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afa75d-8adc-4867-a073-2f6a50f6ae5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.617378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afa75d-8adc-4867-a073-2f6a50f6ae5f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.625969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 268/563] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:17.627259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78742139-6a8e-4d62-82fe-0074c197704d None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.627549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78742139-6a8e-4d62-82fe-0074c197704d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.627832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78742139-6a8e-4d62-82fe-0074c197704d None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.631047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 269/564] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:17.631047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78742139-6a8e-4d62-82fe-0074c197704d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.641617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d745e42-6c14-4178-9646-cd5293459cd9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.679427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.680107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.680394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.680676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.681521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:17.681832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.683289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.685003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.701281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 296/565] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:17.702170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.743102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78742139-6a8e-4d62-82fe-0074c197704d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.765392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.777948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d145-e9cf-430e-b62a-c5f07df25235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.779244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d145-e9cf-430e-b62a-c5f07df25235 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.779594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d145-e9cf-430e-b62a-c5f07df25235 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.779901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d145-e9cf-430e-b62a-c5f07df25235 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.780693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d145-e9cf-430e-b62a-c5f07df25235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:17.781000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d145-e9cf-430e-b62a-c5f07df25235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.782431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d145-e9cf-430e-b62a-c5f07df25235 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.795100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 270/566] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:17.796709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517eed-0d53-44c1-8f5c-75e2e50233b4 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.796933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517eed-0d53-44c1-8f5c-75e2e50233b4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.797218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517eed-0d53-44c1-8f5c-75e2e50233b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.809357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794f7d3-36ef-4971-b72f-5e10a918a798 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.813028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9d517eed-0d53-44c1-8f5c-75e2e50233b4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:17.814227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9d517eed-0d53-44c1-8f5c-75e2e50233b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:17.844175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fd7cd-49e7-4561-a0e6-db86b87ee129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:17.844895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd7cd-49e7-4561-a0e6-db86b87ee129 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.845178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd7cd-49e7-4561-a0e6-db86b87ee129 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.845454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd7cd-49e7-4561-a0e6-db86b87ee129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.855153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fd7cd-49e7-4561-a0e6-db86b87ee129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:17.856621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fd7cd-49e7-4561-a0e6-db86b87ee129 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-173fd7cd-49e7-4561-a0e6-db86b87ee129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:17.873756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:17.874650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:17.875577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:17.875577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:17.875577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:17.875577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:17.875577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 297/567] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:17.876118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34ea6c-edd2-4a83-9900-fd116ad3b8dc None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:17.876401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34ea6c-edd2-4a83-9900-fd116ad3b8dc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:17.876676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34ea6c-edd2-4a83-9900-fd116ad3b8dc None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:17.877902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 298/568] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:17.878589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34ea6c-edd2-4a83-9900-fd116ad3b8dc None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.884637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 271/569] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:17.886871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517eed-0d53-44c1-8f5c-75e2e50233b4 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:17.928245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:17.983073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34ea6c-edd2-4a83-9900-fd116ad3b8dc None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:17.987233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517eed-0d53-44c1-8f5c-75e2e50233b4 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.000814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.015915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d1a9f-7aa2-47b7-a9ac-cef1e0bdb555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.016550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d1a9f-7aa2-47b7-a9ac-cef1e0bdb555 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.016831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d1a9f-7aa2-47b7-a9ac-cef1e0bdb555 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.017105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d1a9f-7aa2-47b7-a9ac-cef1e0bdb555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.020327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.021215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.021524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.021801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/4c0cbf8022ee4c37a591ee578b53806c/roles/cc51cc5968f24b14a1e87199902c9b71` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.036319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=4c0cbf8022ee4c37a591ee578b53806c, role_id=cc51cc5968f24b14a1e87199902c9b71)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.038522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.084766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d1a9f-7aa2-47b7-a9ac-cef1e0bdb555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.086202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d1a9f-7aa2-47b7-a9ac-cef1e0bdb555 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.128749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.145893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 272/570] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:17 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/4c0cbf8022ee4c37a591ee578b53806c/roles/cc51cc5968f24b14a1e87199902c9b71 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:18.146713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.187653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 299/571] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:18.189081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b332d-a0de-46e6-8608-12ed4c410a47 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.189377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b332d-a0de-46e6-8608-12ed4c410a47 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.189659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b332d-a0de-46e6-8608-12ed4c410a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.208290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9a2b332d-a0de-46e6-8608-12ed4c410a47 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:18.209517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9a2b332d-a0de-46e6-8608-12ed4c410a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:18.268279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5b6e0-6d13-4e6e-b7c7-5e24d8d651e8 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.285571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 300/572] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:18.291763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b332d-a0de-46e6-8608-12ed4c410a47 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.311911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.312586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.312867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.313143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.313871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:18.314176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.315580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.329953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 273/573] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:18.330870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.359439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.398146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.416019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b332d-a0de-46e6-8608-12ed4c410a47 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.437932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5694ba-3c60-40ec-aba0-c9c2b421e318 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.450737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.451678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.452812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.453095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.463683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:18.471440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:18.472396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:18.473255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 301/574] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:18.473970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.475294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.476083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.476360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.476631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.488726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.490281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:18.509781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:18.510685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:18.511610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:18.511610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:18.511610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:18.511610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:18.511610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 274/575] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:18.512435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.582114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf03eda-a982-4723-b532-f38173e25a76 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.597381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.623955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.624169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9e15-2a19-4a5f-8a04-ac91cf7c9a64 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.624759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.625044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.625323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.627418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.636892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:18.644515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:18.645458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:18.646289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 302/576] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:18.647513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.664502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.665990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.666282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.666566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.674654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.676179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:18.691304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:18.692281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:18.693230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 275/577] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:18.693848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.754004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78ae88-6662-4513-9fd8-99344c4dbb31 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.791254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.792346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.792635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.793072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.793857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:18.795026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.795591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.803666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 303/578] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:18.808368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.810601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8f50-dba6-4d31-b400-880c186ce7d4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.848266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.849282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.849802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.850297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.851272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:18.851792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.853365 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.856214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.867557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 276/579] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:18.868072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:18.870968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.914970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81bfde-041e-4faa-b1b6-44866c6283b1 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:18.951316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:18.952031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:18.952324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:18.952603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:18.953352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:18.953659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:18.955349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:18.964076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 304/580] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:18.966659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:18.977534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9042c-37c4-403f-a28e-7ddc75dcaaf3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.015193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.015860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.016203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.016597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.017557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:19.017864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.019329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.041036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 277/581] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:19.041036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.074141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03252a-8a67-406a-af49-cfdcece42d1e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.092355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.097164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.110597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.111698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.112025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.112339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.123069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.124554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.142240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec9e3a-6ab3-4909-b6c8-9149ede4f4ac None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:19.142606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:19.143534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:19.144428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:19.144428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:19.144428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:19.144428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:19.144428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 305/582] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:19.144710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.183523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.184809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.185359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.185647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.192930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.194384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:19.210025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:19.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:19.211894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 278/583] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:19.213194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.262140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc931a-e632-43f0-b4d9-f1134ee27547 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.299096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.299891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.300180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.300461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.313654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.315117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.321384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa46924-93db-45a0-9b4b-4c9afc48ad87 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:19.334731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:19.335651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:19.336545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:19.336545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:19.336545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:19.336545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:19.336545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 306/584] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:19.336828 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.341162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.363959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.364832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.365120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.365398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.371023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.376026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.377511 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:19.396384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:19.397390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:19.398259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:19.398259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:19.398259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:19.398259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:19.399317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 279/585] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:19.399775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.464778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe392a41-45e5-41b9-b978-bab4b76a174e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.503933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bea31-a3be-43f8-9ccf-b457409948e0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.515902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.516969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.517254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.517565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.523233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:19.523554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.525335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.542324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 307/586] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:19.542324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.554903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.555944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.556384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.556667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.557470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:19.557777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.559233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.575397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 280/587] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:19.575397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.643318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.665405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.685177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcae1-aab0-4dee-be16-80cb06562d3b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.722490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc269d-3599-49eb-bb02-48f13291cf96 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.723623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.724404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.724769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.725137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.725971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:19.726387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.727882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.744210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 308/588] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:19.744210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.764046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.764797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.765153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.765497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.766315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:19.766686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.768127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.785892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 281/589] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:19.785892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.848865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b89880-4976-46af-bbd0-b4b8bf966048 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.877049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.885529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.886569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.886886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.887167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.893093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0680f-2056-4afa-99f8-da5986483c29 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:19.894810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.896297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:19.910867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:19.911837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:19.912796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 309/590] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:19.913428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:19.916286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:19.934056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:19.934741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:19.935055 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:19.935333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:19.936167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=0a839b5b74e44b428f5989dd48cb1f58) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:19.936534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:19.937926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:19.950867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 282/591] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/role_assignments?user.id=0a839b5b74e44b428f5989dd48cb1f58&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:19.950867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.040014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ad594-5171-40ff-8809-0ae814473762 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.079879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa763-c8f9-4f61-8fa8-1b143afb32b5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.082484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.084283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.084645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.084994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.095437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.097627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:20.117455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:20.118455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 310/592] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:20.119520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.136839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.137916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.138208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.138485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.148239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.149975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:20.169581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:20.170510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:20.171438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:20.174959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 283/593] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:20.176770 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.194351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:20.196554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:20.236585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60725737-a6fe-4205-b59f-ef9d6cdeaab4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.272642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.273328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.273618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.273900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.274740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:20.275086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.276529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.289193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf29e6c-99f2-4f1a-986c-658fd9bccbc7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.295174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 311/594] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:20.296288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.326592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec06a7-3a1d-4734-9c9e-2e9e10227fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.327297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec06a7-3a1d-4734-9c9e-2e9e10227fab None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.327584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec06a7-3a1d-4734-9c9e-2e9e10227fab None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.327922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec06a7-3a1d-4734-9c9e-2e9e10227fab None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.328793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec06a7-3a1d-4734-9c9e-2e9e10227fab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:20.329234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec06a7-3a1d-4734-9c9e-2e9e10227fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.330526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec06a7-3a1d-4734-9c9e-2e9e10227fab None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.351338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 284/595] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:20.352666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa883-9f2e-43b2-8f60-524a90aae575 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.352962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa883-9f2e-43b2-8f60-524a90aae575 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.353273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fa883-9f2e-43b2-8f60-524a90aae575 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.358931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 285/596] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:20.358931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fa883-9f2e-43b2-8f60-524a90aae575 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.414583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c1ada-7a4c-4646-9297-fa4b1274f62f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.427062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:20.438859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:20.456129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.456829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.457177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.457438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.458232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:20.458550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.460024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.464798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fa883-9f2e-43b2-8f60-524a90aae575 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.476088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 312/597] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:20.476088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.506577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a631f-c54d-47ec-b53d-db9a4aa01117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.507404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a631f-c54d-47ec-b53d-db9a4aa01117 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.507691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a631f-c54d-47ec-b53d-db9a4aa01117 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.507973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a631f-c54d-47ec-b53d-db9a4aa01117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.519204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a631f-c54d-47ec-b53d-db9a4aa01117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.520870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a631f-c54d-47ec-b53d-db9a4aa01117 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-de6a631f-c54d-47ec-b53d-db9a4aa01117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:20.538858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:20.539765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:20.540655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:20.540655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:20.540655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:20.540655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:20.540655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 286/598] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:20.541487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd0645-e585-4b24-a8b0-15e2ab6186fe None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.541487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd0645-e585-4b24-a8b0-15e2ab6186fe None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.541827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd0645-e585-4b24-a8b0-15e2ab6186fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.558223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-60fd0645-e585-4b24-a8b0-15e2ab6186fe None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:20.559928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-60fd0645-e585-4b24-a8b0-15e2ab6186fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:20.581632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5420b-f928-4325-a335-965d4c203dca None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.619174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.619966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.620253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.620533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.629584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 287/599] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:20.630691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd0645-e585-4b24-a8b0-15e2ab6186fe None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.637508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.639079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:20.657918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:20.658938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:20.659832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:20.659832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:20.659832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:20.659832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:20.659832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 313/600] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:20.660560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.690460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:20.703363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:20.741114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd0645-e585-4b24-a8b0-15e2ab6186fe None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.779892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.780776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.781026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08c691-4418-4bf6-84f9-562a325bc00e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:20.781132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.781319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/497a2c9e3fe04d9e85d513c9beb4f6bd/roles/cc51cc5968f24b14a1e87199902c9b71` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.799106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=497a2c9e3fe04d9e85d513c9beb4f6bd, role_id=cc51cc5968f24b14a1e87199902c9b71)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.800556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.820160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:20.820160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:20.820160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:20.820160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:20.820551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:20.820551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:20.821181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:20.832641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 314/601] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:20.833404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.875277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 288/602] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:20 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/497a2c9e3fe04d9e85d513c9beb4f6bd/roles/cc51cc5968f24b14a1e87199902c9b71 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:20.876436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:20.948980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:20.963417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26287-fffd-44e5-a4c8-c5524159e039 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.004801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:21.008519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937308e4-013f-4138-baf0-7013e9278860 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.014846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.015676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.015963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.020912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.031728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:21.045439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:21.046465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:21.047349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 315/603] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:21.048052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.064164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.064867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.065127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.065405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.066140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:21.066444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.067991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.081951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 289/604] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:21.082789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.171752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186cc17-0ce2-4e67-a516-66cd7439608f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.190174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da660-9a11-43b8-b16f-270fe00dc532 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.208202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.209227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.209728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.210229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.218152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.219896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.227195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.227871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.228159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.228493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.229255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:21.229567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.231058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:21.237344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:21.238213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:21.239491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:21.240465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 290/605] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:21.241270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.242134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 316/606] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:21.247563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.262765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:21.283218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:21.349599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba40646-b26e-402b-9847-ee93649cc601 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.353083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91df4d-f34c-4633-a946-6a8d76285205 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.387882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.389014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.389633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.390064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.398877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.399262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.400198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.400598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.401010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.401158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.413360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.414955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:21.419379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:21.420349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:21.421335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:21.424119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 291/607] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:21.425166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:21.437972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:21.438995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:21.439892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:21.439892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:21.439892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:21.439892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:21.442900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 317/608] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:21.443876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.523370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:21.547223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:21.552041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316db6c7-0eee-4a15-b5b4-326297fa2421 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.572097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051ab7-2e34-41ce-adbf-26a40952e962 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.594632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.595570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.596007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.596454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.597424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:21.597901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.599553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.613319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 292/609] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:21.615077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.627566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.628438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.628828 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.629248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.630155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:21.630569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.632856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.653745 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 318/610] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:21.654946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.741763 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77e05-3c7a-4714-a6bb-e10ad8419692 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.772082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a948c-12e2-41de-a2ae-848b6aa28bc3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.790100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.791009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.791441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.791868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.792951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:21.793405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.795048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.808076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:21.810126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 293/611] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:21.811143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.818948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:21.832441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.833486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.833888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.834261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/c6bbb0e4d7ca44fc8cb68fdc96260caa/roles/cc51cc5968f24b14a1e87199902c9b71` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:21.851742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=c6bbb0e4d7ca44fc8cb68fdc96260caa, role_id=cc51cc5968f24b14a1e87199902c9b71)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:21.853362 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:21.932308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8ef3-0235-4ad3-95f8-35fdf68750a1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:21.966327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 319/612] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:21 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/c6bbb0e4d7ca44fc8cb68fdc96260caa/roles/cc51cc5968f24b14a1e87199902c9b71 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:21.977365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:21.978337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9db653-2671-41c2-86e8-9cbee4294186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:21.981594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9db653-2671-41c2-86e8-9cbee4294186 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:21.982144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9db653-2671-41c2-86e8-9cbee4294186 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:21.983530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9db653-2671-41c2-86e8-9cbee4294186 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/99a49aca72844411b6bc1feff566cc7e/roles/cc51cc5968f24b14a1e87199902c9b71` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.019303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9db653-2671-41c2-86e8-9cbee4294186 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=99a49aca72844411b6bc1feff566cc7e, role_id=cc51cc5968f24b14a1e87199902c9b71)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:22.022111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9db653-2671-41c2-86e8-9cbee4294186 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:22.100824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 294/613] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:21 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/99a49aca72844411b6bc1feff566cc7e/roles/cc51cc5968f24b14a1e87199902c9b71 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:22.102595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2cd37-dc56-4cb7-9e03-a4e9fd33dd4a None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:22.103123 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2cd37-dc56-4cb7-9e03-a4e9fd33dd4a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:22.103615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2cd37-dc56-4cb7-9e03-a4e9fd33dd4a None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.105828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 295/614] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:22.118404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea66682-8d56-4ebd-9906-b23637da31f6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:22.119077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea66682-8d56-4ebd-9906-b23637da31f6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:22.119749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea66682-8d56-4ebd-9906-b23637da31f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.146008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45face-2973-420b-b89b-4c85d2d0f13f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:22.159562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-aea66682-8d56-4ebd-9906-b23637da31f6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:22.160786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-aea66682-8d56-4ebd-9906-b23637da31f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:22.206196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:22.206939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:22.207484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:22.207673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.218925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:22.220384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:22.231980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:22.238983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:22.239994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:22.240948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 320/615] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:49:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:22.248046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:22.263572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 296/616] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:22.295666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:22.296172 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea66682-8d56-4ebd-9906-b23637da31f6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:22.378810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad279ee9-aaff-4ecd-bd48-30088d32dbfc None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:22.430596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea66682-8d56-4ebd-9906-b23637da31f6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:22.433814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:22.435117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:22.435401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:22.435678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.436732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:22.437044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:22.438639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:22.483551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 321/617] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:49:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:22.484565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:22.539687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:22.540562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:22.540850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:22.541126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.570430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:22.587663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:22.589910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:22.592079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 297/618] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:22.598800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:22.602857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:22.603996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bc03c-a539-439f-907e-650d5bf933be None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:22.657719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:22.658383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:22.658672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:22.658976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.659227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:22.733957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd1c68-39fa-4761-869b-e8c931fd3940 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:22.783336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:22.784291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:22.784579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:22.784863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:22.785683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:22.786000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:22.787525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:22.797011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 298/619] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:22.803377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:22.807884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:22.810033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:22.977804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:22.993490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 322/620] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:49:22.999273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.013353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeab63b-5634-4a04-bdb2-76b60a41bbd9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.017973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:23.080120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.081332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.082765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.083287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.099979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:23.102699 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:23.133809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:23.134848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:23.135803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:23.135803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:23.135803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:23.135803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:23.145733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 299/621] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:23.155916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.182672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a237f-5451-4306-82f3-abb41ffa7ed0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.228240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a7d8-0d12-463d-a458-e4fd5618d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.229597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a7d8-0d12-463d-a458-e4fd5618d101 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.230117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a7d8-0d12-463d-a458-e4fd5618d101 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.231576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a7d8-0d12-463d-a458-e4fd5618d101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.245056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a7d8-0d12-463d-a458-e4fd5618d101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:23.247468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a7d8-0d12-463d-a458-e4fd5618d101 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:23.265769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703211-48bb-469a-9ea0-b09ecfb80cce None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-4e45a7d8-0d12-463d-a458-e4fd5618d101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:23.270959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:23.272035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:23.273142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:23.273142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:23.273142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:23.273142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:23.279309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 323/622] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:23.282138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59540ec-cb7d-4424-b741-83a5ce86a9fa None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.282423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59540ec-cb7d-4424-b741-83a5ce86a9fa None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.282701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59540ec-cb7d-4424-b741-83a5ce86a9fa None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.285344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 324/623] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:23.288700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59540ec-cb7d-4424-b741-83a5ce86a9fa None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.321617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c5df3-c9ea-4b5a-9b2e-51ddf8afd763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.323359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5df3-c9ea-4b5a-9b2e-51ddf8afd763 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.323874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5df3-c9ea-4b5a-9b2e-51ddf8afd763 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.324606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c5df3-c9ea-4b5a-9b2e-51ddf8afd763 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.325907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c5df3-c9ea-4b5a-9b2e-51ddf8afd763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:23.326788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c5df3-c9ea-4b5a-9b2e-51ddf8afd763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:23.328678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c5df3-c9ea-4b5a-9b2e-51ddf8afd763 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:23.349814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:23.357217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 300/624] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:23.357217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da2aa5-d1e4-497d-83ec-3522f996c71e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.357217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da2aa5-d1e4-497d-83ec-3522f996c71e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.357217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da2aa5-d1e4-497d-83ec-3522f996c71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.383791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a9da2aa5-d1e4-497d-83ec-3522f996c71e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:23.385797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a9da2aa5-d1e4-497d-83ec-3522f996c71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:23.402252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:23.418636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59540ec-cb7d-4424-b741-83a5ce86a9fa None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.466990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.467810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.468213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.468591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.469424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:23.469832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:23.471329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:23.488516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 325/626] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:23.489618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.490365 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 301/626] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:23.491339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da2aa5-d1e4-497d-83ec-3522f996c71e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.607525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba04d8-2360-4e82-b007-3f143eee1038 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.610784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:23.637977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da2aa5-d1e4-497d-83ec-3522f996c71e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.650041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.650983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.651368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.651743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.661166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:23.662722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:23.677713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:23.679577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:23.681838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:23.683106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.683106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.683106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.683106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.686853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 326/627] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:23.686853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.689624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:23.691164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:23.709250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:23.711044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 302/628] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:23.712814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.724582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:23.803610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90b48-7164-45f2-b049-d19332369ac8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.841708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba39c1-8c34-4f96-859c-a3bea2cc4059 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:23.856594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.858344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.858803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.859528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.875045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:23.879342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:23.880139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:23.880526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:23.880905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:23.881854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:23.882267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:23.883962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:23.885254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:23.886401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:23.888004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:23.897483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 327/629] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:23.898694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.914608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 303/630] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:23.915733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:23.933265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:23.987927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.030174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ee095-443e-439c-8f67-e02b8c483da0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.037254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96dde9-76a6-41d6-8648-b827920465fd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.077182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.078615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.079072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.079607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.080838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:24.081397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.081964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.082722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.083133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.083488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.083611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.084459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:24.084863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.086526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.099565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 304/631] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:24.101003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.106953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 328/632] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:24.107987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.208836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.225102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d413-b16d-4769-ab68-bdfc798870c3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.231788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d24d-2995-4a7b-b1d6-86cdfd7331ab None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.255368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.266215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.270935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.270935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.270935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.279032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.279935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.280146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.280380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.282847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.284867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.291417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.292875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:24.306594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:24.307531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:24.308437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:24.308437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:24.308437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:24.308437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:24.311202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 305/633] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:24.312249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:24.316743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:24.317655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:24.318569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:24.318569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:24.318569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:24.318569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:24.318569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 329/634] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:24.323476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.432752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c04b75-6ffb-43d6-be1f-5685ba9de2da None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.436075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22152e51-c62c-45cc-b8bf-a27d59d6358c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.466528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac5f4d-e4f1-4303-adc1-f9b3ac11a587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.467159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5f4d-e4f1-4303-adc1-f9b3ac11a587 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.467448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5f4d-e4f1-4303-adc1-f9b3ac11a587 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.467729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5f4d-e4f1-4303-adc1-f9b3ac11a587 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.468450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac5f4d-e4f1-4303-adc1-f9b3ac11a587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:24.468730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.468838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac5f4d-e4f1-4303-adc1-f9b3ac11a587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.469382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.469669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.469946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.470117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac5f4d-e4f1-4303-adc1-f9b3ac11a587 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.470781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=4c0cbf8022ee4c37a591ee578b53806c) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:24.471130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.472421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.472532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.478289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 306/635] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/role_assignments?user.id=4c0cbf8022ee4c37a591ee578b53806c&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:24.479098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.481693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 330/636] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:24.483174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585fd0-490b-49f3-b0d7-43a62006184b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.483467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585fd0-490b-49f3-b0d7-43a62006184b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.507243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585fd0-490b-49f3-b0d7-43a62006184b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.507243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 331/637] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:24.507243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d563283-3719-4f62-a74c-1c21d736374c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.507243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d563283-3719-4f62-a74c-1c21d736374c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.507243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d563283-3719-4f62-a74c-1c21d736374c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.507243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 332/638] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:24.507243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d563283-3719-4f62-a74c-1c21d736374c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.534657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.598495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7028bb-b506-43d6-a6ba-4da43bdba775 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.612964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d563283-3719-4f62-a74c-1c21d736374c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.637486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f16185-4daa-4968-828f-7731e7a598f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.638212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f16185-4daa-4968-828f-7731e7a598f1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.638454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f16185-4daa-4968-828f-7731e7a598f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.638738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f16185-4daa-4968-828f-7731e7a598f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.639525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f16185-4daa-4968-828f-7731e7a598f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:24.639837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f16185-4daa-4968-828f-7731e7a598f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.642373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f16185-4daa-4968-828f-7731e7a598f1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.653547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4838-41d1-4ed2-a064-6c2bbd1e72d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.654098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4838-41d1-4ed2-a064-6c2bbd1e72d2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.654387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4838-41d1-4ed2-a064-6c2bbd1e72d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.654665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4838-41d1-4ed2-a064-6c2bbd1e72d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.659539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 307/639] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:24.660904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6db3e-6011-45c9-ac67-b0272524e5a8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.661204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6db3e-6011-45c9-ac67-b0272524e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.661491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6db3e-6011-45c9-ac67-b0272524e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.662561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4838-41d1-4ed2-a064-6c2bbd1e72d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.664188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4838-41d1-4ed2-a064-6c2bbd1e72d2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.678520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-79d6db3e-6011-45c9-ac67-b0272524e5a8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:24.679822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-79d6db3e-6011-45c9-ac67-b0272524e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-595a4838-41d1-4ed2-a064-6c2bbd1e72d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:24.681358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:24.682267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:24.683228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 333/640] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:24.684766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d12d-17ea-4f09-90ca-476240d564c5 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.685329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d12d-17ea-4f09-90ca-476240d564c5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.685329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d12d-17ea-4f09-90ca-476240d564c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.702254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e778d12d-17ea-4f09-90ca-476240d564c5 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:24.703962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e778d12d-17ea-4f09-90ca-476240d564c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:24.758496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 308/641] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:24.759663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6db3e-6011-45c9-ac67-b0272524e5a8 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.763610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.781461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 334/642] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:24.782496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778d12d-17ea-4f09-90ca-476240d564c5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.794988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:24.870514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6db3e-6011-45c9-ac67-b0272524e5a8 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.886643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778d12d-17ea-4f09-90ca-476240d564c5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:24.909050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.910101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.910646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.911249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.919768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.921223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.922545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:24.923229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:24.923511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:24.923786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:24.924568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:24.924877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:24.926279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:24.937002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:24.937990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:24.938961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:24.939517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 335/643] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:24.939517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.944602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 309/644] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:24.944602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:24.990936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.045186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.048162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f321ce-94aa-48a1-945a-1ab48b02bfa5 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.055396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03777c-1208-435c-b62e-2e77b08aa7fc None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.083734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.084524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.084807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.085086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.091608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.092407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.092692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.092968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.096198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:25.103375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:25.103820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:25.104733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:25.105725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:25.110382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 336/645] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:25.111234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:25.112073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:25.112953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 310/646] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:25.114706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.219979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed92d01-451c-4772-b2c8-4e71209d78d0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.223697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5022d9-9a41-4855-8550-be13f8401856 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.226938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.256208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.257403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.257849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.258383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/0a839b5b74e44b428f5989dd48cb1f58/roles/cc51cc5968f24b14a1e87199902c9b71` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.259932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.260691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.260980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.261259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.262116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:25.262433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.263885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.275438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=0a839b5b74e44b428f5989dd48cb1f58, role_id=cc51cc5968f24b14a1e87199902c9b71)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.277056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.281801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 311/647] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:25.282440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.297589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.355212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 337/648] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:25 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/0a839b5b74e44b428f5989dd48cb1f58/roles/cc51cc5968f24b14a1e87199902c9b71 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:25.367888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.406722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93b3a4-dc5b-42c7-ba99-fe5605ce0481 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.460297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.461367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.461861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.462372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.463410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:25.463949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.466808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.480395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 312/649] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:25.481903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.497529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220c170-2735-4522-8a69-eb08241d9787 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.541817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.542495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.542778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.543108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.544529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:25.544847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.546219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.556582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 338/650] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:25.556582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.575639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.577015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.608926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecafba-a218-4e35-b84e-3337c588c33f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.655000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.655812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.656212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.656535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.669626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aa845-5f6b-43a3-b9c3-a01e0d8fad58 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.709751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.710716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.711126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.711505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.722426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.724047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:25.743481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:25.744620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:25.745726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:25.745726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:25.745726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:25.745726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:25.747836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 339/651] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:25.748724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.753858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.755342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.829108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.844032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:25.863923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 313/652] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:25.865202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.884332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0e4a8-e847-4052-a7d4-1191fab8f280 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:25.926569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:25.927708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:25.928874 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:25.929863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:25.945299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:25.947226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:25.968970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:25.970077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:25.971331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:25.971331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:25.971331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:25.971331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:25.973927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 340/653] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:25.974961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:25.982512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb549-4bae-4955-ac7e-888e313b8374 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.023947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47503-2392-465b-b790-f3292001d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.024786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47503-2392-465b-b790-f3292001d491 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.025171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47503-2392-465b-b790-f3292001d491 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.025552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47503-2392-465b-b790-f3292001d491 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.026390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f47503-2392-465b-b790-f3292001d491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:26.026837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f47503-2392-465b-b790-f3292001d491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.028536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f47503-2392-465b-b790-f3292001d491 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.041682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 314/654] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:26.042780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47503-2392-465b-b790-f3292001d491 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.077702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.102672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf22f-87cf-4890-b085-eebc4f34ecac None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.128939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.141949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.142793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.143123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.143541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.155137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.156781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.162547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47503-2392-465b-b790-f3292001d491 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:26.176479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:26.177406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:26.179029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:26.179029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:26.179029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:26.179029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:26.179029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 341/655] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:26.179029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.206999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.208456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.209015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.209468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.210524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:26.211242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.212657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.232077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 315/656] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:26.233718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.297549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70f48c-b564-4dc8-a2a9-6f7209871f1a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.334090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.334928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.335221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.335503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.343772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.345412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.361800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:26.369566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:26.381748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:49:26.382686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:26.383370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f519f-ea92-4f68-ae38-f485a69fcb7d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.383474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 342/657] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:26.383474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.411885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.413049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.413540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.414012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.415037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:26.415544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.417131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.419414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.431244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 316/658] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:26.432465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.499533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8527-ede1-4cf9-a809-cefa298a245d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.540756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.541619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.541911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.542194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.550595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.552042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.553730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa732ee-7de1-43b2-8fbb-64fcafa206a3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:26.567537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:26.568756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 343/659] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:26.570052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.604832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.606784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.607194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.607581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.608721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:26.609140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.611792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.632086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 317/660] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:26.632965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.646273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.675463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.684912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8dcda-4642-4b7d-a22c-3d79a5c6c5a3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.720230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cf28d-8e0d-428e-98ee-380fcc38886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.721022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cf28d-8e0d-428e-98ee-380fcc38886a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.721311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cf28d-8e0d-428e-98ee-380fcc38886a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.721591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cf28d-8e0d-428e-98ee-380fcc38886a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.728526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cf28d-8e0d-428e-98ee-380fcc38886a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.729964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cf28d-8e0d-428e-98ee-380fcc38886a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.741431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832926-a0d4-4b9f-9278-54bd8f0c775c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-a31cf28d-8e0d-428e-98ee-380fcc38886a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:26.744314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:26.745389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:26.746422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 344/661] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:26.746942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cef13-daa0-486f-b3bc-7a7419151519 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.747012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cef13-daa0-486f-b3bc-7a7419151519 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.747267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cef13-daa0-486f-b3bc-7a7419151519 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.748771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 345/662] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:26.749499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cef13-daa0-486f-b3bc-7a7419151519 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.784654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.785469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.785766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.786116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.787074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:26.787523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.788999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.807297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 318/663] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:26.808309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:26.871548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cef13-daa0-486f-b3bc-7a7419151519 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.875974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.907554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.908295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.908705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.909085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.914213 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b56e18-458b-40c4-8b97-fbec9cb68511 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:26.934195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:26.951831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184a64e-1cce-4629-9520-423c2c757ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:26.952499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a64e-1cce-4629-9520-423c2c757ffd None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.952794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a64e-1cce-4629-9520-423c2c757ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.953075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a64e-1cce-4629-9520-423c2c757ffd None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.953869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184a64e-1cce-4629-9520-423c2c757ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:26.954180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184a64e-1cce-4629-9520-423c2c757ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.955635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184a64e-1cce-4629-9520-423c2c757ffd None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:26.968311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 319/664] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:26.969544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee22c6-da66-4c58-92db-bba5db9a2f85 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:26.969835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee22c6-da66-4c58-92db-bba5db9a2f85 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:26.970114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee22c6-da66-4c58-92db-bba5db9a2f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:26.986704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-97ee22c6-da66-4c58-92db-bba5db9a2f85 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:26.987756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:26.987938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-97ee22c6-da66-4c58-92db-bba5db9a2f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:26.989581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.060643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 320/665] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:27.061511 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee22c6-da66-4c58-92db-bba5db9a2f85 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.104407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 346/666] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:27.105916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.133910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.162531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.177693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee22c6-da66-4c58-92db-bba5db9a2f85 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.209522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766b395-c776-44ae-8765-8e28a8bb7ea5 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.217996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.218710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.219023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.219309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.246270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.247653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.247946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.248547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.249661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=497a2c9e3fe04d9e85d513c9beb4f6bd) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:27.249976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.252167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.258374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 347/667] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/role_assignments?user.id=497a2c9e3fe04d9e85d513c9beb4f6bd&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:27.259544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.311053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.313578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.389568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa058c-5e69-4349-8e83-39f44df0ebfe None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.399377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.409757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.433289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.435065 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.436013 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.436502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.450481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:27.452472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 321/668] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:27.455979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:27.458728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:27.459698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:27.460549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 348/669] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:27.461251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.570685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671525-42c6-418c-9b27-fd96f5bf57a4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.580738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fa6c-b3de-45c0-879c-389b9be28bc2 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.607156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.608066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.608346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.608623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.616962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031e62-29b5-4863-af72-bd0352c55402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.617785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031e62-29b5-4863-af72-bd0352c55402 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.618115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031e62-29b5-4863-af72-bd0352c55402 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.618402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031e62-29b5-4863-af72-bd0352c55402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.619527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.620966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.629806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031e62-29b5-4863-af72-bd0352c55402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.631286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031e62-29b5-4863-af72-bd0352c55402 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:27.639451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:27.640412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:27.641309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:27.641309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:27.641309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:27.641309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:27.641309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 322/670] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:27.642424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-b4031e62-29b5-4863-af72-bd0352c55402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:27.651453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:27.652389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:27.653321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:27.653321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:27.653321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:27.653321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:27.653321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 349/671] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:27.654041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d07f8-cb04-4c4b-9e47-4b55633e5330 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.658762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d07f8-cb04-4c4b-9e47-4b55633e5330 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.658762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d07f8-cb04-4c4b-9e47-4b55633e5330 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.659569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.660101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 350/672] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:27.660761 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d07f8-cb04-4c4b-9e47-4b55633e5330 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.693906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.750816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5510-1d36-466e-a274-ba0bae3a5807 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.771444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d07f8-cb04-4c4b-9e47-4b55633e5330 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.788227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.788900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.789188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.789471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.790223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:27.790535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.792023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.801039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 323/673] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:27.801838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.812060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe3936-f583-4e08-9c8d-0c9ef9699d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.812737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe3936-f583-4e08-9c8d-0c9ef9699d4d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.813023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe3936-f583-4e08-9c8d-0c9ef9699d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.813300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe3936-f583-4e08-9c8d-0c9ef9699d4d None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.814024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe3936-f583-4e08-9c8d-0c9ef9699d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:27.814331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe3936-f583-4e08-9c8d-0c9ef9699d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.815731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe3936-f583-4e08-9c8d-0c9ef9699d4d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.827669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 351/674] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:27.828704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7952a64-5ecd-4fb1-aab7-2533eac970f7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.828993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7952a64-5ecd-4fb1-aab7-2533eac970f7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.829272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7952a64-5ecd-4fb1-aab7-2533eac970f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.844970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b7952a64-5ecd-4fb1-aab7-2533eac970f7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:27.846158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b7952a64-5ecd-4fb1-aab7-2533eac970f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:27.879947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.912955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e99b5-9c17-40c8-926d-2cf9a88d6dda None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:27.916910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 352/675] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:27.917973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7952a64-5ecd-4fb1-aab7-2533eac970f7 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:27.950125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:27.953027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:27.953791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:27.954143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:27.954499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:27.955332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:27.955706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:27.957136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:27.974512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 324/676] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:27.975389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.038541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7952a64-5ecd-4fb1-aab7-2533eac970f7 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.077197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.078259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.078551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.078847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.080830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b930c6-8d39-4e70-a64f-5e9e54ea9481 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.088844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.090836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:28.109029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:28.110547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:28.112019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:28.112019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:28.112019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:28.112019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:28.115073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 353/677] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:28.115898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.117797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.123065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.123865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.124188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.124467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.131236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.132889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:28.146016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:28.146962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:28.147890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 325/678] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:28.148377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.197990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.228450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf3808-9aee-48e9-874e-359a53bd4b35 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.251661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bafaf4-5d59-495c-a22c-95c6d2e667b4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.263465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.264258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.264547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.264827 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.274849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:28.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:28.283950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:28.284787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 354/679] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:28.285920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.291461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.292420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.292874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.293748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.300812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.302250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:28.317089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:28.317996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:28.318934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 326/680] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:28.319435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.384553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.399729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721b92b-decc-43a7-9ade-f737acb47c00 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.431949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.437544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.437703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecff35-9132-42e4-9c41-3f6e9d76326f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.438219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.438506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.438785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.439549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:28.439861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.441234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.454305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 355/681] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:28.455099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.480434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.481257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.481544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.481934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.482725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:28.483059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.484604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.501892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 327/682] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:28.501892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.562638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eba35e-515f-4383-b833-dabb3ec16d7c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.597379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.598142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.598428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.598743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.599633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:28.599818 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.601190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.605663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0811b85-11f3-435e-aaed-21642a2c5bf3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.614522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 356/683] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:28.614522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.622492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.644217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.644880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.645169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.645451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.646239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:28.646551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.648014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.666353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 328/684] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:28.666353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.678041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.726410 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbc703-9b09-4903-9f5c-a31ea3544929 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.763163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.764219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.764505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.764784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.765568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0694-62ae-4904-b129-9c454828dbec None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.772548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.773977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:28.787963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:28.788930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:28.789889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 357/685] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:28.791297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.803891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.804960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.805279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.805842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.806698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=99a49aca72844411b6bc1feff566cc7e) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:28.807056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.808496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.826851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 329/686] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/role_assignments?user.id=99a49aca72844411b6bc1feff566cc7e&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:28.826851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:28.858304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.933157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225ee6b-b06d-4bfb-b3f9-8b9b41de53b5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.943942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823d36-28da-4cc3-a687-a9160c7dfcef None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:28.968554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:28.975963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.977577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.978071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.978781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.979984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=c6bbb0e4d7ca44fc8cb68fdc96260caa) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:28.980461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:28.984041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:28.989923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:28.990730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:28.991064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:28.991181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 330/687] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/role_assignments?user.id=c6bbb0e4d7ca44fc8cb68fdc96260caa&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:28.991343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:28.992002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.008384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:29.009898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:29.035444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:29.036404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:29.037298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:29.037298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:29.037298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:29.037298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:29.038011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 358/688] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:29.044238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.145570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:29.150087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48f4fb-0cd1-4bcd-9960-e5a618ad2f6a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:29.216606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:29.217274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.217575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.217821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.218670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:29.221513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:29.223111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:29.238019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168978e-1231-45e9-87dd-dacebb2bf8bc None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:29.246869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 331/689] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:49:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:29.252616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.308020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:29.309704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.312160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.313317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.314211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:29.319201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:29.320811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:29.340103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 359/690] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:29.348265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.403926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:29.472755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714465a-4a45-4563-adc3-9665a10e7bf7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:29.559391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ed56-534f-4b16-80cf-0e1753be14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:29.559391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ed56-534f-4b16-80cf-0e1753be14ac None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.559391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ed56-534f-4b16-80cf-0e1753be14ac None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.559391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ed56-534f-4b16-80cf-0e1753be14ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.581418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f7f9-e91b-4c71-9a62-a7551616f5da None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:29.620240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:29.655761 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c571733-6105-4d17-910b-b92e3508c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:29.656609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c571733-6105-4d17-910b-b92e3508c65d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.656903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c571733-6105-4d17-910b-b92e3508c65d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.657232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c571733-6105-4d17-910b-b92e3508c65d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.674533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c571733-6105-4d17-910b-b92e3508c65d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:29.677910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c571733-6105-4d17-910b-b92e3508c65d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9c571733-6105-4d17-910b-b92e3508c65d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:29.698156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:29.699328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:29.700812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:29.704852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 360/691] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:29.706137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83b46-96e8-4cf9-a4f4-4e35650b07e9 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.706432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83b46-96e8-4cf9-a4f4-4e35650b07e9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.706718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83b46-96e8-4cf9-a4f4-4e35650b07e9 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.708366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 361/692] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:29.709717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83b46-96e8-4cf9-a4f4-4e35650b07e9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.715924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808ed56-534f-4b16-80cf-0e1753be14ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:29.717398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808ed56-534f-4b16-80cf-0e1753be14ac None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:29.811336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:29.818971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 332/693] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:29.820289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42772-5ce9-4428-9810-976995b571f2 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.820578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42772-5ce9-4428-9810-976995b571f2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.820858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42772-5ce9-4428-9810-976995b571f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.823099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83b46-96e8-4cf9-a4f4-4e35650b07e9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:29.847806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f7d42772-5ce9-4428-9810-976995b571f2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:29.849903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f7d42772-5ce9-4428-9810-976995b571f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:29.860629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:29.861578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:29.861968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:29.862347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:29.863335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:29.863974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:29.865582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:29.887035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 362/694] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 22 08:49:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:29.888108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:29.928064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:29.952360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 333/695] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:29.952360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d42772-5ce9-4428-9810-976995b571f2 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.025341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cecee-f74c-444b-acc6-f274e14b85d6 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.069718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.070494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.070788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.071112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.072374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d42772-5ce9-4428-9810-976995b571f2 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.084622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.086503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.091148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:30.108453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:30.119775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:30.120728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:30.120728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:30.120728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:30.120728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:30.120728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 363/696] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:30.120728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.121077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.122654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.123169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.123651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.187001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.202756 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.204662 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.225233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d197fd6-cfb2-4045-85e0-23de351fad61 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.260578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.261404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.261692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.262542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.263433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.264670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:30.280024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:30.281303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:30.282397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:30.286755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 364/697] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:30.287806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.333186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 334/698] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:49:30.334312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.363199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.394746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425524f-9c1c-4c9b-a5a7-9e7627f08df7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.428240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.428912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.429206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.429496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.430292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:30.430542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.432045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.440393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.445631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 365/699] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:30.446383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.454877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b89f9-312d-4cac-994f-1bd0a50bf6d0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.491134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.492059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.492559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.493019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.493889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:30.494345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.495960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.501659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 335/700] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:30.502624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.555243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da38bc-6a1b-4336-9014-0e20071607a0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.583179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.591475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.592225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.592513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.592795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.603307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.606176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.614455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce4f87-8e12-456b-9c98-93c3bb7000da None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:30.623584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:30.624499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:30.625517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:30.625517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:30.625517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:30.625517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:30.629574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 366/701] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:30.630346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.656372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.657544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.658088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.658572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.666086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.667817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:30.683379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:30.684931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:30.685946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:30.688460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 336/702] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:30.689532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.705852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.738059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef7b6-b2ab-40c0-a5ce-1f705530d08a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.773736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.774413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.774697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.775010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.775720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:30.776035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.777439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.791136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 367/703] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:30.792168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.804286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f10ed-c525-4306-846d-9523362db847 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.845380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:30.846039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.847002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.847496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.848021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.848961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:30.849515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.851184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.866171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 337/704] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:30.877100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:30.932555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c285e3-7800-47a0-8df8-eaa13fbddf65 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:30.969715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:30.970385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:30.975157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:30.975157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:30.975157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:30.975157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:30.975157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:30.996058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 368/705] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:31.005144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.012123 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.066081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863c2d0-b2a4-4878-8989-b3d167a63995 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.104947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.112252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c6d2-2b2e-4ccc-bbe6-11363c3eb3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.112701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0633047-d3a6-4e08-8506-5fb1e5ae1d4c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.113592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c6d2-2b2e-4ccc-bbe6-11363c3eb3ee None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.114046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c6d2-2b2e-4ccc-bbe6-11363c3eb3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.114487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c6d2-2b2e-4ccc-bbe6-11363c3eb3ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.127276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1c6d2-2b2e-4ccc-bbe6-11363c3eb3ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.129279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1c6d2-2b2e-4ccc-bbe6-11363c3eb3ee None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.149619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.150280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.150569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.150943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.151790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=4c0cbf8022ee4c37a591ee578b53806c) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:31.152164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.154208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-e7c1c6d2-2b2e-4ccc-bbe6-11363c3eb3ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:31.156834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:31.157730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:31.158638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:31.160496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 369/706] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/role_assignments?user.id=4c0cbf8022ee4c37a591ee578b53806c&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:31.161537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 338/707] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:31.172638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.237029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c9c91-7299-4280-b620-c05393ee69fc None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.237580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c9c91-7299-4280-b620-c05393ee69fc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.237580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c9c91-7299-4280-b620-c05393ee69fc None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.239188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 339/708] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:31.247230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462037f7-933b-4946-bdf6-b5d1bda8858a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.247527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462037f7-933b-4946-bdf6-b5d1bda8858a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.247793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462037f7-933b-4946-bdf6-b5d1bda8858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.267192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-462037f7-933b-4946-bdf6-b5d1bda8858a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:31.268410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-462037f7-933b-4946-bdf6-b5d1bda8858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.305351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f9c5b-b433-47c0-9d6b-7f2fa956e433 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.354041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 340/709] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:31.356805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623fea-6a23-4ead-936c-0d74447e5467 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.357345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623fea-6a23-4ead-936c-0d74447e5467 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.357853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623fea-6a23-4ead-936c-0d74447e5467 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.361219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 341/710] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:31.367654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87207f0b-b81e-4ccc-b4c1-7d292493cd8c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.367654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87207f0b-b81e-4ccc-b4c1-7d292493cd8c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.367654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87207f0b-b81e-4ccc-b4c1-7d292493cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.376420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.382857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.382857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.382857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.382857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:31.382857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.382857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.396516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-87207f0b-b81e-4ccc-b4c1-7d292493cd8c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:31.396702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 370/711] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:31.397583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.398461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-87207f0b-b81e-4ccc-b4c1-7d292493cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:31.424748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.462705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.478888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 342/712] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:31.478888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87207f0b-b81e-4ccc-b4c1-7d292493cd8c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.539371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff10c-ad63-4ff0-951e-1d0b0cfe1d98 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.583243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.584802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.585429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.586063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.587033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.588573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:31.601504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:31.602712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:31.603682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:31.606331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 371/713] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:31.607445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.607997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87207f0b-b81e-4ccc-b4c1-7d292493cd8c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.655903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.656578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.656881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.657196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.658050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=0a839b5b74e44b428f5989dd48cb1f58) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:31.658368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.659924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.670037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 343/714] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/role_assignments?user.id=0a839b5b74e44b428f5989dd48cb1f58&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:31.675859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.751734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.761579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:31.782332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ddb3-36c0-4fa1-9907-0905fd9c10ae None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.841700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.842523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.842814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.843122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.851856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9b30-2674-4bff-aa3c-ef5a38473129 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:31.857091 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.859647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:31.886575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:31.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:31.889083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:31.889083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:31.889083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:31.889083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:31.889083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 372/715] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:31.895821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:31.918323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:31.919069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:31.919357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:31.919638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:31.920508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:31.920821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:31.922377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:31.928228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 344/716] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:31.934121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.033661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95fa4-9396-4874-b7c5-113e6b45006c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.058278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db10de4-80ea-43fd-b6c7-b56008aeb7d7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.072508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.073181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.073471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.073753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.074515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:32.074892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.076333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.078714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.080824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:32.090972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 373/717] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:32.097103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:32.101000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc26339-e80d-462c-b2ba-0eb2bec1c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.102801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26339-e80d-462c-b2ba-0eb2bec1c4ac None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.103175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26339-e80d-462c-b2ba-0eb2bec1c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.103473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc26339-e80d-462c-b2ba-0eb2bec1c4ac None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.104260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc26339-e80d-462c-b2ba-0eb2bec1c4ac None admin] RBAC: Adding query filter params (type=network) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:32.104580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc26339-e80d-462c-b2ba-0eb2bec1c4ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.106572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc26339-e80d-462c-b2ba-0eb2bec1c4ac None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.118003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 345/718] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:32.225856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ad39-bd44-48ac-b08c-57bfc339a769 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:32.264244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd8d13-4d21-4377-92a4-8f0b1300f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:32.265264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8d13-4d21-4377-92a4-8f0b1300f558 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:32.265730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8d13-4d21-4377-92a4-8f0b1300f558 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:32.266188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8d13-4d21-4377-92a4-8f0b1300f558 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:32.267125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd8d13-4d21-4377-92a4-8f0b1300f558 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:32.268806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd8d13-4d21-4377-92a4-8f0b1300f558 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:32.373412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 374/719] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:49:32 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:33.321657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a933c-2bec-4dfa-9225-ff2321087f18 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.322175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a933c-2bec-4dfa-9225-ff2321087f18 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.322253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a933c-2bec-4dfa-9225-ff2321087f18 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.323759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 346/720] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:33.329810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502402c7-06ce-4201-be44-283766aee52d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.330105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502402c7-06ce-4201-be44-283766aee52d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.330391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502402c7-06ce-4201-be44-283766aee52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.364671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-502402c7-06ce-4201-be44-283766aee52d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:33.365895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-502402c7-06ce-4201-be44-283766aee52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:33.440637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:33.461375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50848-e3f3-405b-8144-d6939409fd98 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.461671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50848-e3f3-405b-8144-d6939409fd98 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.461953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50848-e3f3-405b-8144-d6939409fd98 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.463530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 347/721] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:33.471752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 375/722] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:33.486391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93004508-9984-49f9-95d7-31cab457913f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.486678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93004508-9984-49f9-95d7-31cab457913f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.486988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93004508-9984-49f9-95d7-31cab457913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.492316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502402c7-06ce-4201-be44-283766aee52d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:33.519829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-93004508-9984-49f9-95d7-31cab457913f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:33.521045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-93004508-9984-49f9-95d7-31cab457913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:33.639752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502402c7-06ce-4201-be44-283766aee52d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:33.650678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 348/723] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:49:33.685915 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93004508-9984-49f9-95d7-31cab457913f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:33.694865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:33.695529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.695809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.696078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.696803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:33.698160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:33.801075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 376/724] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:49:33 2022] POST /identity/v3/services => generated 251 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:33.804552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93004508-9984-49f9-95d7-31cab457913f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:33.821205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:33.866932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:33.868225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:33.868646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:33.869057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:33.890171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:33.898183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:33.899354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:33.900255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:33.903208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 349/725] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:33.906310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:33.970345 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:34.037554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c7180-1f3c-4300-820c-dcf818d3b1cc None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:34.073886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:34.074588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.074906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.075186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.075932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:34.076237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:34.077589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:34.087171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 377/726] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:34.093009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:34.198288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789e00d-b069-4a27-8979-fd6f3a13d262 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:34.234442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b70600-45e8-4445-9103-40479820d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:34.235261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70600-45e8-4445-9103-40479820d55d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.235542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70600-45e8-4445-9103-40479820d55d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.236072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70600-45e8-4445-9103-40479820d55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.249428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b70600-45e8-4445-9103-40479820d55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:34.250931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b70600-45e8-4445-9103-40479820d55d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-e4b70600-45e8-4445-9103-40479820d55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:34.268665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:34.269620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:34.270973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:34.270973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:34.270973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:34.270973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:34.270973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 350/727] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:34.275664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:34.394139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9e559-5614-4839-8b7a-64c45a9e8e07 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:34.407170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:34.453938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:34.454547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.454806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.455092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.455815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:34.456120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:34.457485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:34.469041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b1343-c755-43e5-af59-6c61eec1a1f9 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.469510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b1343-c755-43e5-af59-6c61eec1a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.469589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b1343-c755-43e5-af59-6c61eec1a1f9 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.470932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 351/728] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:34.475792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931692-d0b8-4bae-b47f-be1371735f55 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.476076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931692-d0b8-4bae-b47f-be1371735f55 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.476355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931692-d0b8-4bae-b47f-be1371735f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.491019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 378/729] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:34.500689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:34.503979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f9931692-d0b8-4bae-b47f-be1371735f55 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:34.505161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f9931692-d0b8-4bae-b47f-be1371735f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:34.522951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:34.599078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 352/730] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:49:34.633637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931692-d0b8-4bae-b47f-be1371735f55 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:34.666907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0822570-b7f8-4db0-b1cd-a3c226ea2b87 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:34.706991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b5ee5-dae2-46aa-9fcf-c2122e5479d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:34.707708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5ee5-dae2-46aa-9fcf-c2122e5479d0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.707993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5ee5-dae2-46aa-9fcf-c2122e5479d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.708273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5ee5-dae2-46aa-9fcf-c2122e5479d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.717080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b5ee5-dae2-46aa-9fcf-c2122e5479d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:34.718532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b5ee5-dae2-46aa-9fcf-c2122e5479d0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9d8b5ee5-dae2-46aa-9fcf-c2122e5479d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:34.733750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:34.734952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:34.736401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:34.738857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 379/731] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:49:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:34.740222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ed9c-e43d-473e-92fd-9dadd63c4de0 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.740665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ed9c-e43d-473e-92fd-9dadd63c4de0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.741088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ed9c-e43d-473e-92fd-9dadd63c4de0 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.747115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 380/732] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:34.748030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ed9c-e43d-473e-92fd-9dadd63c4de0 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:34.753641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931692-d0b8-4bae-b47f-be1371735f55 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:34.792838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e0975-8b91-4f3c-8fe8-5483d0b89118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:34.793620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0975-8b91-4f3c-8fe8-5483d0b89118 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.793976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0975-8b91-4f3c-8fe8-5483d0b89118 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.794326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0975-8b91-4f3c-8fe8-5483d0b89118 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.795232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e0975-8b91-4f3c-8fe8-5483d0b89118 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:34.796806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e0975-8b91-4f3c-8fe8-5483d0b89118 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:34.871738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 353/733] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:49:34 2022] POST /identity/v3/services => generated 240 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:34.874051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8832-ad28-4dc6-8196-680d4462c6c1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:34.874451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8832-ad28-4dc6-8196-680d4462c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:34.874856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8832-ad28-4dc6-8196-680d4462c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:34.911833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3feb8832-ad28-4dc6-8196-680d4462c6c1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:34.913259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:34.915150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3feb8832-ad28-4dc6-8196-680d4462c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:34.930644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:35.069529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 354/734] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:35.071646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ed9c-e43d-473e-92fd-9dadd63c4de0 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.096516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb8832-ad28-4dc6-8196-680d4462c6c1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.119974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.120658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.121498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.121781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.122661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:35.123015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:35.124449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:35.144969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 381/735] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:49:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:35.150080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.228236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb8832-ad28-4dc6-8196-680d4462c6c1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.252969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:35.265349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.266226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.266597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.266794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.273629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b653b-c290-44f3-ac01-9e748c72a48a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.277292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:35.279001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:35.286863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:35.287830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:35.288710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 355/736] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:35.294863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.377925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b370970-c390-4096-8a2a-d91089f984d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.378748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370970-c390-4096-8a2a-d91089f984d5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.379059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370970-c390-4096-8a2a-d91089f984d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.379341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370970-c390-4096-8a2a-d91089f984d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.407673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b370970-c390-4096-8a2a-d91089f984d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:35.409132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b370970-c390-4096-8a2a-d91089f984d5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:35.413378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41578f3e-f440-4d0c-b6cd-6245ce83d05d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-7b370970-c390-4096-8a2a-d91089f984d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:35.445271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:35.446319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:35.447256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:35.447256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:35.447256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:35.447256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:35.450977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 382/737] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:35.458962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656f6b6-eb29-462d-8161-86e41196ba6b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.459533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656f6b6-eb29-462d-8161-86e41196ba6b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.459533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656f6b6-eb29-462d-8161-86e41196ba6b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.460813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 383/738] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:35.461496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656f6b6-eb29-462d-8161-86e41196ba6b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.466336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbd9ff-6a1b-4b10-ac97-97aa674b3677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.467036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd9ff-6a1b-4b10-ac97-97aa674b3677 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.467316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd9ff-6a1b-4b10-ac97-97aa674b3677 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.467593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd9ff-6a1b-4b10-ac97-97aa674b3677 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.468355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbd9ff-6a1b-4b10-ac97-97aa674b3677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:35.468664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbd9ff-6a1b-4b10-ac97-97aa674b3677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:35.470044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbd9ff-6a1b-4b10-ac97-97aa674b3677 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:35.482907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 356/739] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:35.482907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333ee2-d609-465c-822c-c711e2271c93 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.482907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333ee2-d609-465c-822c-c711e2271c93 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.482907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333ee2-d609-465c-822c-c711e2271c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.501930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2b333ee2-d609-465c-822c-c711e2271c93 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:35.503996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2b333ee2-d609-465c-822c-c711e2271c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:35.576251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:35.590933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 357/740] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:35.592050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333ee2-d609-465c-822c-c711e2271c93 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.606027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656f6b6-eb29-462d-8161-86e41196ba6b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.656515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.657359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.658124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.658421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.659474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:35.659789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:35.661810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:35.663369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:35.682367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 384/741] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:35.682367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.732828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333ee2-d609-465c-822c-c711e2271c93 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.771391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.772232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.772567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.772856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.784454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:35.785743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:35.804639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:35.805614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:35.806509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:35.806509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:35.806509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:35.806509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:35.809468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37054c3b-65a4-45a7-859d-504c978ecb4f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.811518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 358/742] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:35.812418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.850993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.851797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.852084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.852361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:35.864206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:35.866290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:35.872675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:35.873649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:35.874492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:35.878866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 385/743] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:35.886171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:35.943588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:35.947404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fe07b-0d62-43ee-9bae-c48874c0a3a9 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.994391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:35.994670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137612e-5cae-4915-8185-1dc2200a014d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:35.995701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:35.996739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:35.997421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.006968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.008473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:36.029462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:36.030359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:36.031293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:36.037031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 359/744] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:36.037031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.044950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.045925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.046965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.047508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.048918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:36.049434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.051721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.069364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 386/745] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:36.070424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.172157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f018e50-08e4-41d2-90d3-d4525af85c2a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.174725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:36.180748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49f384-d46b-4ae9-a290-616824b663bd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.203092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:36.217286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.218305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853fb1-b589-4647-ba82-de2e50033a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.218546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.219049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.219156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853fb1-b589-4647-ba82-de2e50033a40 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.219535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853fb1-b589-4647-ba82-de2e50033a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.219817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.219919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853fb1-b589-4647-ba82-de2e50033a40 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.220735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853fb1-b589-4647-ba82-de2e50033a40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:36.221021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:36.221124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853fb1-b589-4647-ba82-de2e50033a40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.221998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.223736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853fb1-b589-4647-ba82-de2e50033a40 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.224063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.235463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 360/746] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:36.236805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.242793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 387/747] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:36.243928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b52a-3ba7-41c1-a515-555fce3aa442 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.244229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b52a-3ba7-41c1-a515-555fce3aa442 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.244516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b52a-3ba7-41c1-a515-555fce3aa442 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.246073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 388/748] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:36.246798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b52a-3ba7-41c1-a515-555fce3aa442 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.349367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9361005-be73-46e9-bc4f-85310072dac8 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.361851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b52a-3ba7-41c1-a515-555fce3aa442 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.384708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.385511 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.385793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.386070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.393975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.395450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.397079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a63769-748f-407e-99e1-c615b8776070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.397929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a63769-748f-407e-99e1-c615b8776070 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.398295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a63769-748f-407e-99e1-c615b8776070 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.398647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a63769-748f-407e-99e1-c615b8776070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.409484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a63769-748f-407e-99e1-c615b8776070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:36.410237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:36.411206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:36.412191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:36.413412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a63769-748f-407e-99e1-c615b8776070 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.413487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 361/749] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:36.413487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f9a63769-748f-407e-99e1-c615b8776070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:36.434719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:36.436007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:36.437169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:36.437169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:36.437169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:36.437169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:36.437169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 389/750] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:36.437480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717b33-22fa-4776-8f90-b8f9f2918fdf None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.437956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717b33-22fa-4776-8f90-b8f9f2918fdf None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.437956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717b33-22fa-4776-8f90-b8f9f2918fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.444086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:36.462708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-99717b33-22fa-4776-8f90-b8f9f2918fdf None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:36.462708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-99717b33-22fa-4776-8f90-b8f9f2918fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:36.477599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:36.521670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f0fb-ee48-4640-b88e-ef79b75a88e4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.531025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 390/751] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:36.531025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717b33-22fa-4776-8f90-b8f9f2918fdf None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.561304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.562189 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.562476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.562757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/4c0cbf8022ee4c37a591ee578b53806c/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.564806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=4c0cbf8022ee4c37a591ee578b53806c, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.566188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.627618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717b33-22fa-4776-8f90-b8f9f2918fdf None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.660335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 362/752] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:36 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/4c0cbf8022ee4c37a591ee578b53806c/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:36.660966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.666592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.667693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.668188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.668699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.669887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:36.671220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.672995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.700383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 391/753] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:36.701652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.726095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:36.785735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:36.804033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a702-b51d-4dcc-afb4-6ece22755750 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.824605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1b78c-e7a3-454f-91f2-976177fbe075 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.856062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.856737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.857027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.857463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.858518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:36.859246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.861655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.865067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:36.865885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:36.866174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:36.866451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:36.869479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:36.869479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:36.878954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 363/754] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:36.878954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:36.881443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:36.882579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:36.883533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:36.884316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 392/755] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:36.884523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:36.972735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:36.996252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37854b79-d112-455b-9363-8b6abebf5fd2 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:36.997094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2ec2-cb1e-48f6-92df-7086dd358ddd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.032788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.033443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.033792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.034071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.034531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.035587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.036124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.036677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.045152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.047037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.049656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:37.065075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:37.066268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:37.067637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:37.069834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 393/756] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:37.070815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.108276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.109857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.177481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ecdaa-45a0-4296-9452-3540886e368a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.216255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 364/757] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:49:37.217112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.222961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493bd5-f012-488e-8147-fbea4ed566d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.223747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493bd5-f012-488e-8147-fbea4ed566d6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.224130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493bd5-f012-488e-8147-fbea4ed566d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.224484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493bd5-f012-488e-8147-fbea4ed566d6 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.225272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493bd5-f012-488e-8147-fbea4ed566d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:37.225653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493bd5-f012-488e-8147-fbea4ed566d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.227139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493bd5-f012-488e-8147-fbea4ed566d6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.236460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 394/758] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:37.236460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e78d-9b8d-4198-b0c6-d6c552b678df None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.236460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e78d-9b8d-4198-b0c6-d6c552b678df None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.236460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e78d-9b8d-4198-b0c6-d6c552b678df None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.236460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 395/759] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:37.236460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e78d-9b8d-4198-b0c6-d6c552b678df None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.239605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.298480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.350072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e78d-9b8d-4198-b0c6-d6c552b678df None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.363000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c314-51d6-49c1-87f8-15ea28cf2596 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.388371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.389165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.389446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.389716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.397798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6615-deb0-4a0a-8771-5339f79e35d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.398695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6615-deb0-4a0a-8771-5339f79e35d7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.399213 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6615-deb0-4a0a-8771-5339f79e35d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.399707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6615-deb0-4a0a-8771-5339f79e35d7 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.400547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.400677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6615-deb0-4a0a-8771-5339f79e35d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:37.400933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6615-deb0-4a0a-8771-5339f79e35d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.402008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.402375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6615-deb0-4a0a-8771-5339f79e35d7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:37.419471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:37.420401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:37.421306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:37.421306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:37.421306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:37.421306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:37.425190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 396/760] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:37.425399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 365/761] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:37.426048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.427152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe735c-f33a-4b4d-88fc-8e0f99385646 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.427470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe735c-f33a-4b4d-88fc-8e0f99385646 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.427735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe735c-f33a-4b4d-88fc-8e0f99385646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.444505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-8efe735c-f33a-4b4d-88fc-8e0f99385646 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:37.445718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8efe735c-f33a-4b4d-88fc-8e0f99385646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:37.485923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.522913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 366/762] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:37.522913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe735c-f33a-4b4d-88fc-8e0f99385646 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.538243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8ea63-645e-47b3-bc67-64223d0ca4f3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.561952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.577907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.577907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.577907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.577907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.578294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:37.578294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.578294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.582506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 397/763] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:37.583332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.666393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe735c-f33a-4b4d-88fc-8e0f99385646 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.702051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.702706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.703055 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.703339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.704042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:37.704347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.705687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.723416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 367/764] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:37.724372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.742254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d890c41-1f9c-47e6-9bc7-5005de31a1ff None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.758611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.775017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.775668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.775976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.776258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.819793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.829068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec978-cfcf-44ec-b139-10573085acae None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:37.848748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.850219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.870082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:37.870905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:37.871185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:37.871463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:37.872121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:37.873489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:37.886907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:37.888080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:37.888921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 368/765] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:37.889737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.969759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 398/766] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:49:37.971266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:37.992430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:37.993636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b05a7-6169-4d63-9dc4-e15b17cb56c5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.029775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.030434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.030719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.031044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.031833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] RBAC: Adding query filter params (interface=public, service_id=cda42e513907480290f9ece5f13b28e6, region_id=RegionOne) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:38.032142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.033506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.045508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 369/767] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/endpoints?service_id=cda42e513907480290f9ece5f13b28e6&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.045508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.067058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:38.088921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fa578-70aa-4a87-b840-f84b5a55e534 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.118946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.119807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.120154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.120496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.127697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.128722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:38.142780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:38.143908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:38.145063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:38.145948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 399/768] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:38.151077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc3a8-7285-45dd-8613-192328ffba50 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.151197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.188232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.188892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.189177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.189456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.190156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] RBAC: Adding query filter params (name=network) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:38.190464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.192227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.197528 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 370/769] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.198231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.236168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:38.257581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d0ab5-4422-4b82-a90f-15d5ca470d61 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.284575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:38.292499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.293310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.293596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.293871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.301255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61089d-b936-4587-a9de-5126147e226b None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.304957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.306688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:38.324392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:38.325343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:38.326240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:38.326240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:38.326240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:38.326240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:38.326240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 400/770] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:38.326541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.342425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.343054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.343390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.343670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.344355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.345728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.357608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 371/771] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.359618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.465368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf349-3602-4be7-97b0-fb2ae481d3eb None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.472262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37556f-2cec-49ad-a7db-59059ca08687 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.507230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:38.509993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.510671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.511038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.511391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.512589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] RBAC: Adding query filter params (type=network) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:38.512902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.514280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.516751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.517931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.518369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.518651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.519545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:38.519873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.521287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.524806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 372/772] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.525658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.537255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 401/773] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.538229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.547526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:38.654886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb677cf-19fb-45cc-a2db-7189de5c6b74 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.661097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ed3cc-b5c2-47f5-90f8-8738cb867417 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.700247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.701845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.702418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.702962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.704171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] RBAC: Adding query filter params (interface=public, service_id=47a6576d5fcd4b499c7a81c56e8a70bd, region_id=RegionOne) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:38.704781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.705710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.706435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.706789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.706989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.707220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.708008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:38.708380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.709882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.717911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 402/774] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/endpoints?service_id=47a6576d5fcd4b499c7a81c56e8a70bd&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.719011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.727370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 373/775] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.728423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.782704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:38.804640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:38.830414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e065d7f-d80e-49be-985d-be1abf3ee079 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.836351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd89f7-61f6-4785-8c95-8615aafabdcf None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:38.865726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.866387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.866679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.867000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.867830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=0a839b5b74e44b428f5989dd48cb1f58) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:38.868150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.869587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.875670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 403/776] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/role_assignments?user.id=0a839b5b74e44b428f5989dd48cb1f58&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.881805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:38.889394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e35e-8564-4dee-a08d-5b702f439612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:38.890508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e35e-8564-4dee-a08d-5b702f439612 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.891074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e35e-8564-4dee-a08d-5b702f439612 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.891980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e35e-8564-4dee-a08d-5b702f439612 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.893350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01e35e-8564-4dee-a08d-5b702f439612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:38.895409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01e35e-8564-4dee-a08d-5b702f439612 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:38.903560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 374/777] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:38.907478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea54b1-1455-4711-b75b-78d99573f564 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.909092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea54b1-1455-4711-b75b-78d99573f564 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.910165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea54b1-1455-4711-b75b-78d99573f564 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:38.913836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 375/778] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:38.921802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae687c-6c50-4dfe-828d-e1ff785b4c53 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:38.921802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae687c-6c50-4dfe-828d-e1ff785b4c53 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:38.921802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae687c-6c50-4dfe-828d-e1ff785b4c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.010537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94894cd6-cfcf-4166-86cc-03264af97f86 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:39.032267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:39.053476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:39.054315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.054598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.054927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.064002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:39.065580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:39.083378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:39.084340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:39.085535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 404/779] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:39.091488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:39.147362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e9ae687c-6c50-4dfe-828d-e1ff785b4c53 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:39.148619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e9ae687c-6c50-4dfe-828d-e1ff785b4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:39.242138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 376/780] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:39.253597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90fb2e-1aa5-439e-ae4b-03fb56825e28 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:39.275978 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae687c-6c50-4dfe-828d-e1ff785b4c53 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:39.303819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:39.304483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.304766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.305042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.305835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:39.306142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:39.307603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:39.339942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 405/781] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:39.342383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:39.403070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:39.412867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:39.462126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae687c-6c50-4dfe-828d-e1ff785b4c53 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:39.517844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a6f94-8e22-4476-b499-5ed7ed725b45 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:39.524215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:39.525220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.526066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.526541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.550361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:39.557984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:39.559772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:39.560622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:39.565633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 377/782] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:39.570499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:39.592617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:39.593290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.593667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.593954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.594805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=c5e68568568447c3b5324a1e10afac02) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:39.595144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:39.596584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:39.608554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 406/783] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:39 2022] GET /identity/v3/role_assignments?user.id=c5e68568568447c3b5324a1e10afac02&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:39.751852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70eef-e1dc-457f-b896-2b9bcd0f4ef0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:39.780024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:39.794402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:39.799522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.799522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.799522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.799522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:39.799522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:39.799522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:39.807518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 378/784] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:39.813140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:39.922411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afef8b-8ed5-4170-a543-6c2193227427 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:39.923977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:39.957826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:39.958671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:39.958984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:39.959268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:39.975837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:39.977290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:40.004636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:40.005594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:40.006487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:40.006487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:40.006487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:40.006487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:40.006487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 407/785] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:40.013063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:40.131094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6a8ea-c7c0-4db8-a9bd-57ce69ba9353 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.170314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.171003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.171284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.171562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.172287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:40.172595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.173954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.187050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 379/786] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:40.192361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:40.347118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b00ec6-958b-45eb-bc0d-e237542580f5 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.404987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.405709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.405996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.406274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.416374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.418359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:40.438322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:40.439308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:40.440253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 408/787] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:49:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:40.445102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:40.529250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:40.593991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae77a4-7a17-424d-8939-57b83645abfc None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.639114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a840c5-7ec6-47aa-8f8f-ce75c76cee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.640167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a840c5-7ec6-47aa-8f8f-ce75c76cee41 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.640658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a840c5-7ec6-47aa-8f8f-ce75c76cee41 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.641164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a840c5-7ec6-47aa-8f8f-ce75c76cee41 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.642271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a840c5-7ec6-47aa-8f8f-ce75c76cee41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:40.642785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a840c5-7ec6-47aa-8f8f-ce75c76cee41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.644425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a840c5-7ec6-47aa-8f8f-ce75c76cee41 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.672806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 380/788] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:49:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:40.678356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:40.706458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:40.807471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d3d0f-c539-4956-a0d3-7ca9026ca355 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.808153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d3d0f-c539-4956-a0d3-7ca9026ca355 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.808639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d3d0f-c539-4956-a0d3-7ca9026ca355 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.810442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 381/789] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:40.816031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa249be-522f-4eef-bafb-3ae0c0f4311f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.816644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa249be-522f-4eef-bafb-3ae0c0f4311f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.817123 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa249be-522f-4eef-bafb-3ae0c0f4311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.825888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edf461-d67e-4c06-8cae-1c998f1dd211 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:40.861965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:40.862638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:40.863036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:40.863327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:40.864352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-faa249be-522f-4eef-bafb-3ae0c0f4311f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:40.865759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-faa249be-522f-4eef-bafb-3ae0c0f4311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:40.972442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:40.975276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:40.999165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.000804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 382/790] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:41.039678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa249be-522f-4eef-bafb-3ae0c0f4311f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.097962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 409/791] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:49:41.103657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.112386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.181571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa249be-522f-4eef-bafb-3ae0c0f4311f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.238784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.239551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.239830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.240199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.240959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.242324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.243871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6787c3-47d0-4fd0-a108-fcf6ee900b10 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:41.269443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:41.270465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:49:41.271351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:41.280247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 383/792] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:41.281277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.282495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.312627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd996077-5b00-4ade-991c-058f96d0f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.313431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd996077-5b00-4ade-991c-058f96d0f22f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.313721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd996077-5b00-4ade-991c-058f96d0f22f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.314002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd996077-5b00-4ade-991c-058f96d0f22f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.336529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd996077-5b00-4ade-991c-058f96d0f22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.337988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd996077-5b00-4ade-991c-058f96d0f22f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-dd996077-5b00-4ade-991c-058f96d0f22f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:41.371567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:41.372466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:41.373350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:41.373350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:41.373350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:41.373350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:41.373350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 410/793] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:41.374348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eeb14-d722-4490-889e-58eac5079326 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.374639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eeb14-d722-4490-889e-58eac5079326 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.379766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eeb14-d722-4490-889e-58eac5079326 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.385627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 411/794] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:41.385627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eeb14-d722-4490-889e-58eac5079326 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.440310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.444192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b6b3-c789-4ade-94b4-11d2e73db9a1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.480257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c44596-6641-451d-b562-8aa526fac842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.480923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44596-6641-451d-b562-8aa526fac842 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.481209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44596-6641-451d-b562-8aa526fac842 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.481492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44596-6641-451d-b562-8aa526fac842 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.482208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c44596-6641-451d-b562-8aa526fac842 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:41.482520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c44596-6641-451d-b562-8aa526fac842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.483937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c44596-6641-451d-b562-8aa526fac842 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.489540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 384/795] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:41.491189 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82069473-4229-4113-bafd-64cff969e650 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.492057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82069473-4229-4113-bafd-64cff969e650 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.492349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82069473-4229-4113-bafd-64cff969e650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.505128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eeb14-d722-4490-889e-58eac5079326 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.510460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-82069473-4229-4113-bafd-64cff969e650 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:41.512230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-82069473-4229-4113-bafd-64cff969e650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:41.540805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cedb0a-c290-4cd5-bb34-c25339f7b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.541461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cedb0a-c290-4cd5-bb34-c25339f7b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.541750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cedb0a-c290-4cd5-bb34-c25339f7b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.542033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cedb0a-c290-4cd5-bb34-c25339f7b9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.542779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cedb0a-c290-4cd5-bb34-c25339f7b9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:41.543124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cedb0a-c290-4cd5-bb34-c25339f7b9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.544487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cedb0a-c290-4cd5-bb34-c25339f7b9c0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.556707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 412/796] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:41.564582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf792994-0697-4b9d-b1e3-de3d2a643b5c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.564582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf792994-0697-4b9d-b1e3-de3d2a643b5c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.564582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf792994-0697-4b9d-b1e3-de3d2a643b5c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.564582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 413/797] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:41.564582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf792994-0697-4b9d-b1e3-de3d2a643b5c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.594725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 385/798] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:41.594725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82069473-4229-4113-bafd-64cff969e650 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.602353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.681929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf792994-0697-4b9d-b1e3-de3d2a643b5c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.697666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.705021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82069473-4229-4113-bafd-64cff969e650 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.722999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b86f-ef80-426a-9d3a-d642ea144b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.723676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b86f-ef80-426a-9d3a-d642ea144b0e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.723960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b86f-ef80-426a-9d3a-d642ea144b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.724241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b86f-ef80-426a-9d3a-d642ea144b0e None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.725368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162b86f-ef80-426a-9d3a-d642ea144b0e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:41.725680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162b86f-ef80-426a-9d3a-d642ea144b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.727250 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162b86f-ef80-426a-9d3a-d642ea144b0e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.732351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 414/799] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:41.733520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c527c3-5b80-48d8-a5e7-3a79e5964128 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.733807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c527c3-5b80-48d8-a5e7-3a79e5964128 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.734095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c527c3-5b80-48d8-a5e7-3a79e5964128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.744862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.746279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.746416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.746672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.752412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-42c527c3-5b80-48d8-a5e7-3a79e5964128 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:41.753554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.753750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-42c527c3-5b80-48d8-a5e7-3a79e5964128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:41.755016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:41.770562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:41.771685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:41.772608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 386/800] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:41.773101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.831202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 415/801] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:41.832036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c527c3-5b80-48d8-a5e7-3a79e5964128 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.860844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.891558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2726c-ef5d-4db9-b360-6b6da26c5409 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.926013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.926807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.927122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.927395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.938548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:41.943883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c527c3-5b80-48d8-a5e7-3a79e5964128 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:41.946104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:41.947060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:41.947975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 387/802] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:41.948707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:41.966344 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:41.982689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:41.983381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:41.983659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:41.983940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:41.984687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:41.986309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.055381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dbb6c-7a19-4a69-a553-f108a6425cf0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.093804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.094493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.094759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.095071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.095441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 416/803] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:49:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:42.096019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:42.096328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.096489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.097765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.117005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 388/804] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:42.118938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.204437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:42.213027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:42.232135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c7a3-752a-4d2e-8125-2176b7d49b31 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.248570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0942b6a-de1c-49fc-b382-dcb9583675c6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.271190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.272016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.272304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.272590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] PATH_INFO: `/v3/services/network` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.273365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.275608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:42.289115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:42.290389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:42.291514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 417/805] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:42.292987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.293727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d9b51-3875-4039-b687-0697a3999c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.294574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d9b51-3875-4039-b687-0697a3999c94 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.295070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d9b51-3875-4039-b687-0697a3999c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.295524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d9b51-3875-4039-b687-0697a3999c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.296301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d9b51-3875-4039-b687-0697a3999c94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:42.296613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d9b51-3875-4039-b687-0697a3999c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.297991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d9b51-3875-4039-b687-0697a3999c94 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.308200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 389/806] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:42.309284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baae66-d31c-46ed-9a38-6b079ee13dfb None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.309576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baae66-d31c-46ed-9a38-6b079ee13dfb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.309860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baae66-d31c-46ed-9a38-6b079ee13dfb None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.311269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 390/807] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:42.311802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baae66-d31c-46ed-9a38-6b079ee13dfb None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.409406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1d8f-9ecf-42d7-808a-435497dedc73 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.432744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baae66-d31c-46ed-9a38-6b079ee13dfb None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.444896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.445552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.445846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.446109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.447247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=4c0cbf8022ee4c37a591ee578b53806c) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:42.447558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.449008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.462852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 418/808] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/role_assignments?user.id=4c0cbf8022ee4c37a591ee578b53806c&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:42.462852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.466307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:42.473597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:42.478706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac254946-e774-4ada-a6d9-38d54db46045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.479692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254946-e774-4ada-a6d9-38d54db46045 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.480621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254946-e774-4ada-a6d9-38d54db46045 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.480913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254946-e774-4ada-a6d9-38d54db46045 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.481653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac254946-e774-4ada-a6d9-38d54db46045 None admin] RBAC: Adding query filter params (name=network) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:42.481967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac254946-e774-4ada-a6d9-38d54db46045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.483416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac254946-e774-4ada-a6d9-38d54db46045 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.488757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 391/809] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:42.490056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddbaae-7c21-4f65-8761-c9551c39919b None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.490354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddbaae-7c21-4f65-8761-c9551c39919b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.490642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddbaae-7c21-4f65-8761-c9551c39919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.509247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-58ddbaae-7c21-4f65-8761-c9551c39919b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:42.510542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-58ddbaae-7c21-4f65-8761-c9551c39919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:42.595302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 392/810] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:42.596326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddbaae-7c21-4f65-8761-c9551c39919b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.600594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d795-a3ea-4a23-84f9-ab8dad494b71 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.644790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.646626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.647124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.647832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.662867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.664964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:42.683351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:42.684906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:42.686034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:42.686034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:42.686034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:42.686034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:42.686650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 419/811] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:42.687532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.732601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddbaae-7c21-4f65-8761-c9551c39919b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.759311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:42.766010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:42.780892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.781564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.781894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.782182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.782949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] RBAC: Adding query filter params (type=network) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:42.783241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.784597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.790546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 393/812] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:42.791428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.822348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc3b63-86d7-4eaf-a9b1-56d3ed03286e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.867653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.868925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.869291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.869580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.882232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:42.891915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:42.892864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:42.893711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:42.898482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 420/813] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:42.899444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:42.918388 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b4d32-4dc7-46e9-bb23-c99faf59bfba None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:42.960769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:42.961438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:42.961719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:42.961995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:42.963042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:42.963403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:42.964847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:42.984497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 394/814] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:42.984497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.018197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0e867-3288-48da-8097-233c967c40d8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.049505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.051761 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.052695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.053182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.053657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.054925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.056539 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.067069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.101019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f59f1-5a2a-4229-a64f-a3c90b408d45 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.135661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.136913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.137192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.137466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.138254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:43.138564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.139934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.152428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 395/815] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:43.152428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.172120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 421/816] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:49:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:43.173475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.358076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161f846-84fe-4029-8c0c-77ff9cde7a59 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.379382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.405660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46a0e-3ae5-47d9-8ebf-9c4ae6dcd558 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.406372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.407269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.407551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.407828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.418773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.420608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:43.439236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:43.440224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:43.441160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 396/817] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:43.449185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.457896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.458939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.459406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.459884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.471186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.472975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:43.493254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:43.494165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:43.495088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:43.495088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:43.495088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:43.495088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:43.497934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 422/818] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:43.503744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.530388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.569905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c401209-0f31-4b04-a789-3ba9003dcb45 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.627685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.628462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.628658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.629389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.630385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:43.630867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.632559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.649665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7472c-36e8-4b72-8156-7950815feb05 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.661457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 397/819] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:43.666761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.696616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.697824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.698491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.698898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.699761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.701297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:43.701614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.703286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.718793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 423/820] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:43.724219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.780328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd37a-8417-471f-8362-23f8fdd69964 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.817271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.818061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.818346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.818628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.829713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.831178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.832097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:43.849563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:43.850683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:43.851819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:43.851819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:43.851819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:43.851819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:43.855047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 398/821] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:43.859329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c25f-ea40-4b7d-bc20-6a753188d78f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:43.859456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.899743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:43.900981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:43.901796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:43.902262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:43.911958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:43.914234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:43.933391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:43.934562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:43.935649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:43.938188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 424/822] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:43.944002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:43.945377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:43.964834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9f0f-ff69-4236-8362-b0b3b458a76a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.001464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.002571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.003092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.003622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.004540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:44.005100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.007986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.025834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 399/823] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:44.027017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.067563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96bea3-9e12-414a-a349-fcf01b2b713b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.109041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.109723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.110009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.110290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.111429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:44.111743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.113628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.125797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.140931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 425/824] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 22 08:49:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:44.143138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca792abd-63f2-4714-aee2-a15ccb2ffeec None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.144018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.187185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d32cf-7d71-49be-b7ce-3ea1000bae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.188020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d32cf-7d71-49be-b7ce-3ea1000bae8f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.188555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d32cf-7d71-49be-b7ce-3ea1000bae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.188555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d32cf-7d71-49be-b7ce-3ea1000bae8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.196725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d32cf-7d71-49be-b7ce-3ea1000bae8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.198170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d32cf-7d71-49be-b7ce-3ea1000bae8f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-6a5d32cf-7d71-49be-b7ce-3ea1000bae8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:44.212869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:44.213741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:44.214709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 400/825] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:44.215665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c597f00-905e-4a07-91ca-97c5f088bf4c None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.215665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c597f00-905e-4a07-91ca-97c5f088bf4c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.215931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c597f00-905e-4a07-91ca-97c5f088bf4c None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.217232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 401/826] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:44.219943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c597f00-905e-4a07-91ca-97c5f088bf4c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.223281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.259887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1567f1-0cdc-476c-b3c5-57d8c5eac444 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.296820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ee94-be62-4bd1-aee5-584ec8799be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.297674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ee94-be62-4bd1-aee5-584ec8799be2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.297953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ee94-be62-4bd1-aee5-584ec8799be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.298226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ee94-be62-4bd1-aee5-584ec8799be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.310422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ee94-be62-4bd1-aee5-584ec8799be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.311917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ee94-be62-4bd1-aee5-584ec8799be2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.327430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c597f00-905e-4a07-91ca-97c5f088bf4c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-1e10ee94-be62-4bd1-aee5-584ec8799be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:44.330480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:44.331464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:44.332576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:44.332576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:44.332576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:44.332576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:44.334088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 426/827] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:44.335662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f81b-b204-426e-abc0-87d77c96e93b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.335943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f81b-b204-426e-abc0-87d77c96e93b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.336219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f81b-b204-426e-abc0-87d77c96e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.357946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9405f81b-b204-426e-abc0-87d77c96e93b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:44.359160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9405f81b-b204-426e-abc0-87d77c96e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:44.374102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.374772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.375084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.375375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.376170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:44.376484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.377914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.394052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 402/828] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:44.394052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.416191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.443104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 427/829] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:44.443104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405f81b-b204-426e-abc0-87d77c96e93b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.465995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.507335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e4355-36e8-41e1-80c0-c9b0242594de None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.541390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.542146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.543078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.543361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.544259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:44.544402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.545767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.550340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405f81b-b204-426e-abc0-87d77c96e93b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.557621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 403/830] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:44.558464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.592088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.593425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.594625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.595110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/0a839b5b74e44b428f5989dd48cb1f58/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.597206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=0a839b5b74e44b428f5989dd48cb1f58, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.598777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.659356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621bd4-a3a2-416a-a8cb-6fcb41fe054a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.681451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.684779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 428/831] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:44 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/0a839b5b74e44b428f5989dd48cb1f58/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:44.685819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.705288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741eecc-c885-4af1-a6ba-00259d53590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.706540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741eecc-c885-4af1-a6ba-00259d53590f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.706854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741eecc-c885-4af1-a6ba-00259d53590f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.707131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741eecc-c885-4af1-a6ba-00259d53590f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.707806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741eecc-c885-4af1-a6ba-00259d53590f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.709275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741eecc-c885-4af1-a6ba-00259d53590f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-d741eecc-c885-4af1-a6ba-00259d53590f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:44.722593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:44.723713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:44.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 404/832] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:44.726080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd994-bffd-4b2d-a3d6-e9dfed05127f None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.726080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd994-bffd-4b2d-a3d6-e9dfed05127f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.726080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd994-bffd-4b2d-a3d6-e9dfed05127f None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.733339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 405/833] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:44.733339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd994-bffd-4b2d-a3d6-e9dfed05127f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.756032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.821538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03c80-69b6-4575-b144-977fd1d26713 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.855485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd994-bffd-4b2d-a3d6-e9dfed05127f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:44.862490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab13a01-2e8d-4ff2-87ba-07ef8b83f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.863720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab13a01-2e8d-4ff2-87ba-07ef8b83f88c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.863720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab13a01-2e8d-4ff2-87ba-07ef8b83f88c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.863919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab13a01-2e8d-4ff2-87ba-07ef8b83f88c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.871749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab13a01-2e8d-4ff2-87ba-07ef8b83f88c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.873192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab13a01-2e8d-4ff2-87ba-07ef8b83f88c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-fab13a01-2e8d-4ff2-87ba-07ef8b83f88c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:44.887765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:44.888674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:44.889558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 429/834] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:44.890046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161020-6694-4615-ad42-54dfef07e686 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.890679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161020-6694-4615-ad42-54dfef07e686 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.890679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161020-6694-4615-ad42-54dfef07e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.897170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:44.897837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:44.898120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:44.898395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:44.899135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:44.899445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:44.900799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:44.910333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 406/835] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:44.910333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:44.910926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-94161020-6694-4615-ad42-54dfef07e686 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:44.912150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-94161020-6694-4615-ad42-54dfef07e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:44.965197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:44.982876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 430/836] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:44.982876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94161020-6694-4615-ad42-54dfef07e686 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.026854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:45.031905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160e49a-aedd-48a5-ae48-56eb3c959e5b None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.076536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.077541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.077986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.078263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.079079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:45.079394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.081034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.098193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 407/837] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:45.098193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.103098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94161020-6694-4615-ad42-54dfef07e686 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.138651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.139440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.139739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.140027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.140742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:45.141054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.142420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.147402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 431/838] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:45.148172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.219435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0837f-9f7a-407c-9c99-e49cd2909843 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.233127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:45.259983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.260992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.261279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.261555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.262227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.263864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.273547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:45.279783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:45.280781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:45.281611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 408/839] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:45.284858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641f4f-c93f-4d1e-b8be-361ad5495618 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.289599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.327143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.328288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.328580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.328861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/c5e68568568447c3b5324a1e10afac02/roles/cc51cc5968f24b14a1e87199902c9b71` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.362757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=c5e68568568447c3b5324a1e10afac02, role_id=cc51cc5968f24b14a1e87199902c9b71)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.365451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.410361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6889ed-db7e-4ed4-9f10-5f532a3271a7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.431440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 432/840] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:45 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/c5e68568568447c3b5324a1e10afac02/roles/cc51cc5968f24b14a1e87199902c9b71 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:49:45.453857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6b709-7b1a-4e39-85c0-812dfee94f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.454651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b709-7b1a-4e39-85c0-812dfee94f81 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.454988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b709-7b1a-4e39-85c0-812dfee94f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.455269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b709-7b1a-4e39-85c0-812dfee94f81 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.456069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6b709-7b1a-4e39-85c0-812dfee94f81 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:45.456384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6b709-7b1a-4e39-85c0-812dfee94f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.457864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6b709-7b1a-4e39-85c0-812dfee94f81 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.463936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 409/841] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:45.469352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:45.584077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a449fbe-f755-4bda-94d0-b364e7a1ade1 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:45.621698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695fff-69c0-4014-a005-790ac6090a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:45.622365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695fff-69c0-4014-a005-790ac6090a49 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:45.622651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695fff-69c0-4014-a005-790ac6090a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:45.622956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695fff-69c0-4014-a005-790ac6090a49 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:45.623670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695fff-69c0-4014-a005-790ac6090a49 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:45.623975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695fff-69c0-4014-a005-790ac6090a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:45.625344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695fff-69c0-4014-a005-790ac6090a49 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:45.630366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 433/842] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:46.761848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ff2d-9714-4c42-8461-faad38a10353 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.762369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ff2d-9714-4c42-8461-faad38a10353 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.762478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ff2d-9714-4c42-8461-faad38a10353 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.764098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 410/843] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:46.769519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f447-1882-409a-8205-c7fffb67f448 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:46.769905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f447-1882-409a-8205-c7fffb67f448 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:46.770087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f447-1882-409a-8205-c7fffb67f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:46.787212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3669f447-1882-409a-8205-c7fffb67f448 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:46.788398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3669f447-1882-409a-8205-c7fffb67f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:46.790703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:46.862931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 434/844] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:46.882772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ff2d-9714-4c42-8461-faad38a10353 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:46.926206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:46.990289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ff2d-9714-4c42-8461-faad38a10353 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.024522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.025630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.026119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.027143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.037537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:47.045825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:47.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:49:47.047654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:47.050369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 411/845] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:47.056141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f447-1882-409a-8205-c7fffb67f448 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.162902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f447-1882-409a-8205-c7fffb67f448 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.197690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b156c-abf9-4958-87ff-8641d16ce2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.198919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b156c-abf9-4958-87ff-8641d16ce2aa None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.199215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b156c-abf9-4958-87ff-8641d16ce2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.199495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b156c-abf9-4958-87ff-8641d16ce2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.200247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b156c-abf9-4958-87ff-8641d16ce2aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:47.200556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b156c-abf9-4958-87ff-8641d16ce2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.201927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b156c-abf9-4958-87ff-8641d16ce2aa None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:47.207331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:47.210888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 435/846] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:47.216825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.248011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8523-c782-4275-920c-205239c10377 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.248320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8523-c782-4275-920c-205239c10377 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.248584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8523-c782-4275-920c-205239c10377 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.250212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 436/847] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:49:47.255312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5600d-5528-4095-9067-3e3cb6085172 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.255612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5600d-5528-4095-9067-3e3cb6085172 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.255898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5600d-5528-4095-9067-3e3cb6085172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.273676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0de5600d-5528-4095-9067-3e3cb6085172 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:47.275173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0de5600d-5528-4095-9067-3e3cb6085172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:47.328141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:47.332537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd4d0d-73b8-4733-a5c3-131e635df491 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.370973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 437/848] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:49:47.384758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.385561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.386422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.386709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.391236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5600d-5528-4095-9067-3e3cb6085172 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.398471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.400025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:47.419917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:47.420864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:47.421758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:47.421758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:47.421758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:47.421758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:47.425589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 412/849] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:47.427289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.522711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5600d-5528-4095-9067-3e3cb6085172 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.555625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e849cc-531b-47e7-a7ee-a0ee8bf3be37 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.555922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:47.562684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a0cbc-b322-46d9-93d4-a7af5fb5b23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.563665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0cbc-b322-46d9-93d4-a7af5fb5b23a None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.564239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0cbc-b322-46d9-93d4-a7af5fb5b23a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.564789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0cbc-b322-46d9-93d4-a7af5fb5b23a None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.565723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a0cbc-b322-46d9-93d4-a7af5fb5b23a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.567332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a0cbc-b322-46d9-93d4-a7af5fb5b23a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:47.591287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83052a9b-5e4e-47b1-a703-b2237b876d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83052a9b-5e4e-47b1-a703-b2237b876d09 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.592244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83052a9b-5e4e-47b1-a703-b2237b876d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.592526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83052a9b-5e4e-47b1-a703-b2237b876d09 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.593252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83052a9b-5e4e-47b1-a703-b2237b876d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:47.593564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83052a9b-5e4e-47b1-a703-b2237b876d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.594949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83052a9b-5e4e-47b1-a703-b2237b876d09 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:47.606549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 413/850] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:47.607859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d8c32-3ef9-427c-9b80-85ff0ca4028c None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.608127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d8c32-3ef9-427c-9b80-85ff0ca4028c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.608403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d8c32-3ef9-427c-9b80-85ff0ca4028c None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.609774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 414/851] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:47.614179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d8c32-3ef9-427c-9b80-85ff0ca4028c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.627222 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:47.654505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 438/852] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:49:47 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:49:47.656121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387b5ef-6273-4d18-a22a-6e8739236231 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.656417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387b5ef-6273-4d18-a22a-6e8739236231 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.656697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387b5ef-6273-4d18-a22a-6e8739236231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.677815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0387b5ef-6273-4d18-a22a-6e8739236231 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:47.680563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0387b5ef-6273-4d18-a22a-6e8739236231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:47.745712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d8c32-3ef9-427c-9b80-85ff0ca4028c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.772331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 439/853] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:47.772331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907cab-01bb-43d5-9c39-33130b788faa None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.772331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907cab-01bb-43d5-9c39-33130b788faa None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.772331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907cab-01bb-43d5-9c39-33130b788faa None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.772331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 440/854] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:47.778844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee28b9-b950-4905-8334-9747980e7194 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.778844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee28b9-b950-4905-8334-9747980e7194 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.778844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee28b9-b950-4905-8334-9747980e7194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.794527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.795414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.795696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.795969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.797224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-93ee28b9-b950-4905-8334-9747980e7194 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:47.798871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-93ee28b9-b950-4905-8334-9747980e7194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:47.805327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:47.806761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:47.822314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:47.824111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 415/855] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:49:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:47.825783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.885396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 441/856] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:49:47.886989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee28b9-b950-4905-8334-9747980e7194 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:47.899746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:47.938804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a892-0536-4caf-80cb-0428a85d1470 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:47.951307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:47.972677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:47.973462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:47.973744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:47.974018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:47.985218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:47.993067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:47.997110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 416/857] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:49:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:47.998038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.008620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee28b9-b950-4905-8334-9747980e7194 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.044490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.045164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.045453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.045731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.046570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:48.046914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.048349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.070420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 442/858] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 22 08:49:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:48.070420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.106128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654cba4-977f-4d2e-a775-f0faf07a23d3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.134639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.145191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.145911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.146200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.146479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.147239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.148598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.177138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8756a-a0f5-411e-bdab-fa85588987ca None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.186684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.208522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 417/859] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:49:47 2022] POST /identity/v3/services => generated 269 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:48.211707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.219959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.220644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.220924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.221196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.221968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:48.222273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.224821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.237903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 443/860] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:48.243047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.345382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e628-ff9a-4917-9596-8dc611d7e1c5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.354368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f87cfa-af34-4703-9075-40f3fecbe4a8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.387097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.387749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.388958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.389236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.394756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.395610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.395900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.396180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.410625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.412102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:48.437155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:48.438095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:48.439025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:48.439025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:48.439025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:48.439025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:48.440311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 444/861] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:48.446642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.461060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.473601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.480363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.481818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.573817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffb4b8-f273-487f-9ab0-8c82c810d4a4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.609228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 418/862] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:49:48.616386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.616386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.616386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.616386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.616751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:48.616751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.616888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.616961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.627969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 445/863] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:48.633663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.706280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.723057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a49c12-ac54-494d-9ebe-fce047986190 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.727157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.741766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8593-f6d8-4ab6-ae3e-6f99a797a11a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.764865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.765980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.766375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.766791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.779854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.781440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.781608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.782056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.782482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.783471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.790765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.793218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:48.804197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:48.805611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:48.806726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:48.806726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:48.806726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:48.806726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:48.807992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 419/864] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:48.812608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:48.813610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:48.814554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:48.815173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.816842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 446/865] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:48.822095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.925881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354a709-5d2f-4741-adc3-0e2e39eddef4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.960181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe4d2-f1b1-4a1d-b3b5-b80edc6eb380 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:48.962738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:48.963491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:48.963778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:48.964087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:48.964821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:48.965133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:48.966497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:48.973217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:48.983016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 420/866] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:48.984309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:48.999528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.000250 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.000542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.000826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.001674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:49.002155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.004302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.015096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:49.028905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 447/867] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:49.033881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.100145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2b850-722b-4ea6-bc01-8c66a5c36cf7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.149853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.151241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.151712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.152362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.157428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a8fb2-7cfe-4237-bb9d-cd5c49d2491d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.161545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.163118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:49.183160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:49.184068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:49.189893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 421/868] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:49.191904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.201168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.201948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.202249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.202534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.262130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:49.288022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:49.297388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.300014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.308270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578541c-de37-4a88-893c-2aeefd3f2604 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.345091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.345914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.351781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.352219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.353159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:49.353785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.358809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.375533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 422/869] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:49.383300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.431584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 448/870] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:49:49.439245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.507407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cbded-95be-48c9-a28e-3982804da574 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.530842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:49.550094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:49.555541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.555911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b929ed-3df1-4044-b385-678fdbc45a46 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.556543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.557005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.557651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.559958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=0a839b5b74e44b428f5989dd48cb1f58) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:49.560437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.562035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.570443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 423/871] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:49 2022] GET /identity/v3/role_assignments?user.id=0a839b5b74e44b428f5989dd48cb1f58&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:49.598133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.598979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.599261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.600283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.612242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.613820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:49.633492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:49.636553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:49.637449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:49.637449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:49.637449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:49.637449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:49.637449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 449/872] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:49.641264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.754304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274eb5-bd9e-44fc-952d-e8eb5b03e7ca None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.789525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5f183-48f5-4d6e-a348-b09b6b83db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.790166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f183-48f5-4d6e-a348-b09b6b83db1f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.790505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f183-48f5-4d6e-a348-b09b6b83db1f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.790788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f183-48f5-4d6e-a348-b09b6b83db1f None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.791580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f183-48f5-4d6e-a348-b09b6b83db1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:49.791933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f183-48f5-4d6e-a348-b09b6b83db1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.793799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f183-48f5-4d6e-a348-b09b6b83db1f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.806610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 424/873] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:49.812573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.844491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf6f6a-522c-4932-99fb-25d5f7327466 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.845009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf6f6a-522c-4932-99fb-25d5f7327466 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.845295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf6f6a-522c-4932-99fb-25d5f7327466 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.847501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 425/874] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:49:49.853495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcdb58-137e-4217-b475-153f5679e45f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.853776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcdb58-137e-4217-b475-153f5679e45f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.854100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcdb58-137e-4217-b475-153f5679e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.875999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c3dcdb58-137e-4217-b475-153f5679e45f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:49.877669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c3dcdb58-137e-4217-b475-153f5679e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:49.922378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca8deb-fc40-46f9-9206-7c9b2e6d8679 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:49.924336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:49.959837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 426/875] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:49.964177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:49.965243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:49.965734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:49.966215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:49.973824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:49.975601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:49.983885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcdb58-137e-4217-b475-153f5679e45f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:49.993557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:49.994530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:49.996359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:50.003087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 450/876] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:50.004162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.016540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:50.117315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcdb58-137e-4217-b475-153f5679e45f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.118644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd08f8-d8df-450d-af46-6fa41f3fc758 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.155063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.155862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.156148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.156470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.157126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.158542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.164020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.164885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.165326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.165774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.166719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:50.167780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.169377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:50.171651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:50.172845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:50.173725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 427/877] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:50.178840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.193623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 451/878] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:50.201408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.220994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:50.290166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:50.297474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfe60c-5933-4fc2-9bca-4bed9fcaba3d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.334121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c52f0b-76c9-4008-8ded-6d09bc4d1698 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.335088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97518b-5c8b-4657-af93-ba763c7532f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.335758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97518b-5c8b-4657-af93-ba763c7532f2 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.336050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97518b-5c8b-4657-af93-ba763c7532f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.336327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97518b-5c8b-4657-af93-ba763c7532f2 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.337044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97518b-5c8b-4657-af93-ba763c7532f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:50.337485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97518b-5c8b-4657-af93-ba763c7532f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.338911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97518b-5c8b-4657-af93-ba763c7532f2 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.347201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 428/879] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:50.347201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b059-35e0-4f33-a64d-ed2a4b3d91a9 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.347201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b059-35e0-4f33-a64d-ed2a4b3d91a9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.347201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b059-35e0-4f33-a64d-ed2a4b3d91a9 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.351036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 429/880] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:50.351858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b059-35e0-4f33-a64d-ed2a4b3d91a9 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.379080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861d336-697c-44e7-a2e4-a55203408f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.380023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d336-697c-44e7-a2e4-a55203408f33 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.380311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d336-697c-44e7-a2e4-a55203408f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.380755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d336-697c-44e7-a2e4-a55203408f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.381916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861d336-697c-44e7-a2e4-a55203408f33 None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=c5e68568568447c3b5324a1e10afac02) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:50.382385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861d336-697c-44e7-a2e4-a55203408f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.383914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861d336-697c-44e7-a2e4-a55203408f33 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.390364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 452/881] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/role_assignments?user.id=c5e68568568447c3b5324a1e10afac02&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:50.400467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaddb37-172a-4ecd-85f1-fdc20c6937ff None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.400743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaddb37-172a-4ecd-85f1-fdc20c6937ff None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.400992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaddb37-172a-4ecd-85f1-fdc20c6937ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.423638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7eaddb37-172a-4ecd-85f1-fdc20c6937ff None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:50.424431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7eaddb37-172a-4ecd-85f1-fdc20c6937ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:50.486595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:50.491084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b059-35e0-4f33-a64d-ed2a4b3d91a9 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.522855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 453/882] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:50.540069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.540867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.541093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.541375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.542785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:50.543129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.544879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.547426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaddb37-172a-4ecd-85f1-fdc20c6937ff None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.554863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 430/883] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:50.557807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.616514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:50.663612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaddb37-172a-4ecd-85f1-fdc20c6937ff None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.686311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dd2ee-3163-40cf-a755-bc103113c8ac None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.704358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.705171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.705456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.705731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.706383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.707827 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:50.721538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:50.722517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:50.723449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 454/884] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:50.728457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.728961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.729352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.729745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.730127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.731087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] RBAC: Adding query filter params (interface=public, service_id=dfcca25fee0a42f6abe46d341bc9841f, region_id=RegionOne) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:50.731631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.733199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.739422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 431/885] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/endpoints?service_id=dfcca25fee0a42f6abe46d341bc9841f&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:50.744892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.775785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:50.838374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f947e-3711-4b1d-9b99-2160026ece28 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.868811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:50.875379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.877577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.877577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.877577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.877577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:50.877862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.878941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992e4f-db8f-41c0-b50c-d6318ed4f285 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:50.879387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.889070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 455/886] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:50.890401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:50.927541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:50.928468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:50.928785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:50.929935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:50.930628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:50.932027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:50.946940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 432/887] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/services => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:49:51.008836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc46a-aaed-4ca1-b749-5f1b57afe8cb None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.046639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.047372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.047656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.047938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.048669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:51.048976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.050375 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.061105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 456/888] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:51.062579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.171024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:51.179864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499590c2-e53f-47b9-b03b-797a9c4f4d6c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.216171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17971559-7401-4d42-8068-3db64d81eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.216893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971559-7401-4d42-8068-3db64d81eb40 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.217178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971559-7401-4d42-8068-3db64d81eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.217504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971559-7401-4d42-8068-3db64d81eb40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.218310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971559-7401-4d42-8068-3db64d81eb40 None admin] RBAC: Adding query filter params (interface=public, service_id=47953616b9784b5a9327d09457982ca2, region_id=RegionOne) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:51.218623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971559-7401-4d42-8068-3db64d81eb40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.220018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971559-7401-4d42-8068-3db64d81eb40 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.225615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 433/889] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:49:51 2022] GET /identity/v3/endpoints?service_id=47953616b9784b5a9327d09457982ca2&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:51.231018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.290965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:51.342725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eefd95-2303-4f91-a240-b1d226c6a0fa None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.380187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea145ab5-d23c-43da-873a-e03e51fd7392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.380862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145ab5-d23c-43da-873a-e03e51fd7392 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.381153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145ab5-d23c-43da-873a-e03e51fd7392 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.381437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145ab5-d23c-43da-873a-e03e51fd7392 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.382128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea145ab5-d23c-43da-873a-e03e51fd7392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.383522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea145ab5-d23c-43da-873a-e03e51fd7392 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:51.390320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 457/890] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:49:51 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:51.730108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fdce9-39a3-4422-86ef-95b716dba16f None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.730499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fdce9-39a3-4422-86ef-95b716dba16f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.730669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fdce9-39a3-4422-86ef-95b716dba16f None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.732248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 434/891] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:51.737907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3cc4d-e4bd-4dff-80e1-61286733ac5b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.738200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3cc4d-e4bd-4dff-80e1-61286733ac5b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.738483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3cc4d-e4bd-4dff-80e1-61286733ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.756022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-72d3cc4d-e4bd-4dff-80e1-61286733ac5b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:51.757202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-72d3cc4d-e4bd-4dff-80e1-61286733ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:51.829362 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 458/892] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:51.851109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fdce9-39a3-4422-86ef-95b716dba16f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:51.953315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fdce9-39a3-4422-86ef-95b716dba16f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:51.988162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:51.988891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:51.989171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:51.989442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:51.990086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:51.991466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:52.003615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:52.005530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:52.006626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 435/893] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:52.010686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3cc4d-e4bd-4dff-80e1-61286733ac5b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.060713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:52.114601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3cc4d-e4bd-4dff-80e1-61286733ac5b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.149348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4985d-8de2-4b46-bde4-a2be9f8962c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.150027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4985d-8de2-4b46-bde4-a2be9f8962c1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.150308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4985d-8de2-4b46-bde4-a2be9f8962c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.150587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4985d-8de2-4b46-bde4-a2be9f8962c1 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.151881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4985d-8de2-4b46-bde4-a2be9f8962c1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:52.152193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4985d-8de2-4b46-bde4-a2be9f8962c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.153574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4985d-8de2-4b46-bde4-a2be9f8962c1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.159147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 459/894] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:49:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:52.167686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.190847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:52.274897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272f709-c53d-4ac2-82f5-b90dc46897ad None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.316710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3259774-ef86-4395-bd43-87f8bdf0a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.317377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259774-ef86-4395-bd43-87f8bdf0a7bd None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.317716 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259774-ef86-4395-bd43-87f8bdf0a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.318000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259774-ef86-4395-bd43-87f8bdf0a7bd None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.318769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3259774-ef86-4395-bd43-87f8bdf0a7bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:52.319114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3259774-ef86-4395-bd43-87f8bdf0a7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:52.320477 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3259774-ef86-4395-bd43-87f8bdf0a7bd None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:52.325889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 436/895] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:49:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:52.665963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95dc5-25a3-414a-8a9b-5c9b8608f7dd None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.665963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95dc5-25a3-414a-8a9b-5c9b8608f7dd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.665963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95dc5-25a3-414a-8a9b-5c9b8608f7dd None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.665963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 460/896] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:52.674316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6896b4a-ed17-4713-ae99-0e9beda37768 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.674316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6896b4a-ed17-4713-ae99-0e9beda37768 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.674316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6896b4a-ed17-4713-ae99-0e9beda37768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.690559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e6896b4a-ed17-4713-ae99-0e9beda37768 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:52.692020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e6896b4a-ed17-4713-ae99-0e9beda37768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:52.761423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 437/897] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:52.785584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c95dc5-25a3-414a-8a9b-5c9b8608f7dd None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.898752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c95dc5-25a3-414a-8a9b-5c9b8608f7dd None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:52.912359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:52.933758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:52.934571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:52.934878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:52.935162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:52.946184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:52.961244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:52.962249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:52.963588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 461/898] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 22 08:49:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:52.968883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6896b4a-ed17-4713-ae99-0e9beda37768 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:52.987200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.073088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6896b4a-ed17-4713-ae99-0e9beda37768 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.108525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db918c78-ac2e-4749-aa5d-875c8c3491f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.109202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918c78-ac2e-4749-aa5d-875c8c3491f3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.109493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918c78-ac2e-4749-aa5d-875c8c3491f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.109776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918c78-ac2e-4749-aa5d-875c8c3491f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.110787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918c78-ac2e-4749-aa5d-875c8c3491f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:53.111133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918c78-ac2e-4749-aa5d-875c8c3491f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.112501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918c78-ac2e-4749-aa5d-875c8c3491f3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.121835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 438/899] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 22 08:49:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:53.127570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.208942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191c2e-9c1e-4a3a-8076-ca8eb49b7741 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.209151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191c2e-9c1e-4a3a-8076-ca8eb49b7741 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.209625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191c2e-9c1e-4a3a-8076-ca8eb49b7741 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.211282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 439/900] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:49:53.216384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f575af-974a-47c0-a372-849f120ef018 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.216923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f575af-974a-47c0-a372-849f120ef018 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.217412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f575af-974a-47c0-a372-849f120ef018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.236387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-81f575af-974a-47c0-a372-849f120ef018 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:53.236831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa728b9-4c9a-4df6-8907-b5c4f8231645 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.238329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-81f575af-974a-47c0-a372-849f120ef018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.280892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.281700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.282531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.282845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.297124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.299367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.319145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 440/901] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:53.319829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:53.320723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:53.321618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:53.321618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:53.321618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:53.321618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:53.321618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 462/902] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:53.326848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f575af-974a-47c0-a372-849f120ef018 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.335650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.340008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.378275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.453866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f575af-974a-47c0-a372-849f120ef018 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.467247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593565-606f-4a5c-97d6-2067102a0cca None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.497509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.498237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.498433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.498734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.499476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:53.499774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.501873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.513123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.514300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.514803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.515376 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.516259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.518024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.519358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 441/903] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:53.524777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:53.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:53.536620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:49:53.537603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:53.541779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 463/904] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:53.543187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.625036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.641730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.653599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02bfaf-f867-4ddb-a225-70d51b8ed8a8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.664584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366487-2dad-4f20-937f-572aea84c37c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.689525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bae5d-0ce0-46b7-ade6-a90a421ceabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.690340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bae5d-0ce0-46b7-ade6-a90a421ceabe None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.690626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bae5d-0ce0-46b7-ade6-a90a421ceabe None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.690931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bae5d-0ce0-46b7-ade6-a90a421ceabe None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.691637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bae5d-0ce0-46b7-ade6-a90a421ceabe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:53.692201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bae5d-0ce0-46b7-ade6-a90a421ceabe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.693306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bae5d-0ce0-46b7-ade6-a90a421ceabe None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.703415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 464/905] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:53.703415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ae0fa-d9ca-4086-9991-9e267d88dacc None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.703415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ae0fa-d9ca-4086-9991-9e267d88dacc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.703415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ae0fa-d9ca-4086-9991-9e267d88dacc None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.703415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 465/906] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:53.706032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7efdaa-1116-4ede-ab96-dc6a8ead52b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.706556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ae0fa-d9ca-4086-9991-9e267d88dacc None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.706873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7efdaa-1116-4ede-ab96-dc6a8ead52b0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.707163 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7efdaa-1116-4ede-ab96-dc6a8ead52b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.707488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7efdaa-1116-4ede-ab96-dc6a8ead52b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.716050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7efdaa-1116-4ede-ab96-dc6a8ead52b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.717546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7efdaa-1116-4ede-ab96-dc6a8ead52b0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-cb7efdaa-1116-4ede-ab96-dc6a8ead52b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:53.732155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:53.733161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:53.734134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 442/907] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:53.734751 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3baa8-9aaf-4ad9-9b1f-658aa784ba61 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.735638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3baa8-9aaf-4ad9-9b1f-658aa784ba61 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.735638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3baa8-9aaf-4ad9-9b1f-658aa784ba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.752324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-01b3baa8-9aaf-4ad9-9b1f-658aa784ba61 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:53.753512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-01b3baa8-9aaf-4ad9-9b1f-658aa784ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:53.822600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ae0fa-d9ca-4086-9991-9e267d88dacc None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.825853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 443/908] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:53.826463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3baa8-9aaf-4ad9-9b1f-658aa784ba61 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.860853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.861522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.861794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.862069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.862779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:53.863119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.864478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:53.869620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 466/909] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:53.874946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:53.892317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.897607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:53.942350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3baa8-9aaf-4ad9-9b1f-658aa784ba61 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.978142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b415198-8e4c-47b3-8ccd-4b197dfdeeb2 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:53.978530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:53.979770 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:53.980073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:53.980337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:53.981182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:53.981515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:53.982992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.001491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 444/910] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:54.002293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.019293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.020368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.020866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.021325 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.022151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.023712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:54.036424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:54.037466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:49:54.038307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:54.041242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 467/911] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 22 08:49:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:54.042895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.112622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944b4d-b23e-468f-8e34-6afdd783a661 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.128443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.130445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.149019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.149681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.149967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.150248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.150355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17990c-32eb-4a07-84f5-45d398e89bec None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.151575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.152936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.186490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.187166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.187457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.187740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.228406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 445/912] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:54.229219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.276990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.278935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.368160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f2d2-dc55-4d22-a684-8b5a79b8ca0c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.399102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.408164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ceb2c-c261-46dd-a953-5f0552bc45f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.408841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ceb2c-c261-46dd-a953-5f0552bc45f7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.410483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ceb2c-c261-46dd-a953-5f0552bc45f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.410483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ceb2c-c261-46dd-a953-5f0552bc45f7 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.410483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ceb2c-c261-46dd-a953-5f0552bc45f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:54.410483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ceb2c-c261-46dd-a953-5f0552bc45f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.412750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ceb2c-c261-46dd-a953-5f0552bc45f7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.418482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 446/913] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:54.419063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 468/914] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:49:54.423975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb12b6-458d-4b73-bfd3-f747e02721d0 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.424271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb12b6-458d-4b73-bfd3-f747e02721d0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.424522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.424623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb12b6-458d-4b73-bfd3-f747e02721d0 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.425863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 447/915] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:54.429150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb12b6-458d-4b73-bfd3-f747e02721d0 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.462072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.531272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be2b0-8cf8-4be6-b046-5779d31a3400 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.536223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb12b6-458d-4b73-bfd3-f747e02721d0 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.570507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32674b-d7a1-4aca-abc1-25f9f25083c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.571318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32674b-d7a1-4aca-abc1-25f9f25083c3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.571609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32674b-d7a1-4aca-abc1-25f9f25083c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.571889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32674b-d7a1-4aca-abc1-25f9f25083c3 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.572604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32674b-d7a1-4aca-abc1-25f9f25083c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:54.573426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32674b-d7a1-4aca-abc1-25f9f25083c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.574789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32674b-d7a1-4aca-abc1-25f9f25083c3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.578363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.579185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.579472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.579749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.584695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 469/916] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:54.584695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc00c9-3dd4-4082-bc40-ca46a3b4e1c0 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.584695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc00c9-3dd4-4082-bc40-ca46a3b4e1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.584695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc00c9-3dd4-4082-bc40-ca46a3b4e1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.597235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.598692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.603627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-bcbc00c9-3dd4-4082-bc40-ca46a3b4e1c0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:54.605863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bcbc00c9-3dd4-4082-bc40-ca46a3b4e1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:54.617883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:54.619050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:54.620144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:54.620144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:54.620144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:54.620144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:54.625683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 448/917] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:54.625683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.655378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.681265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 470/918] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:54.682020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc00c9-3dd4-4082-bc40-ca46a3b4e1c0 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.736645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.756512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c78c7-d917-47a5-95b4-9deb188492a6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.784282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc00c9-3dd4-4082-bc40-ca46a3b4e1c0 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:54.793813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.794487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.794886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.795169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.795903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.797256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.818527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:54.819239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:54.819526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:54.819801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:54.820533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:54.820842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:54.822198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:54.833908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 471/919] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:54.834674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.871999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:54.900531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 449/920] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:54.908847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:54.961014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc16c53-c502-4670-8b4d-26309b3cfed9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.017553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.018259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.018548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.018864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.019600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.021509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.048495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec4e91-2ff9-4309-9221-8f3ab93d02bd None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.089801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.090608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.090869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 472/921] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:49:54 2022] POST /identity/v3/services => generated 241 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:49:55.090996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.091779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.099432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.101403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.103457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:55.118635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:55.120211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:55.121164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 450/922] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:55.127104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:55.253162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:55.270624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8a8d3-2b93-4029-90c6-fea1aa6f203b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.307057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be08e7-f452-49fa-bff4-a948e2003ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.308299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be08e7-f452-49fa-bff4-a948e2003ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.308585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be08e7-f452-49fa-bff4-a948e2003ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.308868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be08e7-f452-49fa-bff4-a948e2003ec9 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.309664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be08e7-f452-49fa-bff4-a948e2003ec9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:55.309980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be08e7-f452-49fa-bff4-a948e2003ec9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.311476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be08e7-f452-49fa-bff4-a948e2003ec9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.323809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 473/923] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:55.329808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:55.449903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360bafe-c2e4-40d0-a5f2-4e7038ca7c72 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:55.487489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4aab8-ee91-4069-b51d-3e2dc8440a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:55.488150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4aab8-ee91-4069-b51d-3e2dc8440a99 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:55.488432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4aab8-ee91-4069-b51d-3e2dc8440a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:55.488710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4aab8-ee91-4069-b51d-3e2dc8440a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:55.489547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4aab8-ee91-4069-b51d-3e2dc8440a99 None admin] RBAC: Adding query filter params (role.id=54a508762524467f8c1da2c9cb827b85, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=c5e68568568447c3b5324a1e10afac02) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:55.489863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4aab8-ee91-4069-b51d-3e2dc8440a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:55.491353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4aab8-ee91-4069-b51d-3e2dc8440a99 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:55.498282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 451/924] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:49:55 2022] GET /identity/v3/role_assignments?user.id=c5e68568568447c3b5324a1e10afac02&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=54a508762524467f8c1da2c9cb827b85 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:56.340915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3fd2b-cb06-47ef-9b37-af4991d3c517 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:56.340915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3fd2b-cb06-47ef-9b37-af4991d3c517 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:56.340915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3fd2b-cb06-47ef-9b37-af4991d3c517 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:56.340915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 474/925] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:56.343926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32faea3-1afd-49c0-b67f-df8a0bccff66 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:56.344307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32faea3-1afd-49c0-b67f-df8a0bccff66 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:56.344489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32faea3-1afd-49c0-b67f-df8a0bccff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:56.384183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f32faea3-1afd-49c0-b67f-df8a0bccff66 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:56.385146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f32faea3-1afd-49c0-b67f-df8a0bccff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:56.448348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:56.459530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 452/926] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:56.483151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3fd2b-cb06-47ef-9b37-af4991d3c517 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:56.593038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3fd2b-cb06-47ef-9b37-af4991d3c517 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:56.630765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:56.631462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:56.631755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:56.632036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:56.632762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:56.634190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:56.636475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING keystone.server.flask.common [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 08:49:56.710420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.sql.core [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:49:56.710420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 08:49:56.710420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [parameters: {'id': '1e76175f01fc475a8a49a49ca54e0404', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 08:49:56.710420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e76175f01fc475a8a49a49ca54e0404.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e76175f01fc475a8a49a49ca54e0404. Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:49:56.728042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result.read() Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 08:49:56.729023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application yield resource Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise self.value Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application session.commit() Jun 22 08:49:56.730176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:49:56.731507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:49:56.733001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result.read() Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:49:56.734506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [parameters: {'id': '1e76175f01fc475a8a49a49ca54e0404', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:56.736392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:56.737809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e76175f01fc475a8a49a49ca54e0404. Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:56.739899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 475/927] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jun 22 08:49:56 2022] POST /identity/v3/projects => generated 262 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:56.747964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32faea3-1afd-49c0-b67f-df8a0bccff66 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:56.837575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32faea3-1afd-49c0-b67f-df8a0bccff66 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:56.873168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425e365-17d0-4873-b29b-eec13367b84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:56.873887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425e365-17d0-4873-b29b-eec13367b84a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:56.874174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425e365-17d0-4873-b29b-eec13367b84a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:56.874457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425e365-17d0-4873-b29b-eec13367b84a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:56.881378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425e365-17d0-4873-b29b-eec13367b84a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:56.882818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425e365-17d0-4873-b29b-eec13367b84a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-a425e365-17d0-4873-b29b-eec13367b84a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:56.896701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:56.897654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:56.898839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 453/928] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:56.904240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:56.907428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:57.011163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eee7b-98f6-436b-b409-d36708194ac6 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:57.046662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:57.047357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.047648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.047932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.048694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:57.049006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:57.050641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:57.067007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b483a9-f8f7-4c55-a5a9-234cc6a45596 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.067286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b483a9-f8f7-4c55-a5a9-234cc6a45596 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.067565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b483a9-f8f7-4c55-a5a9-234cc6a45596 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.069160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 454/929] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:57.071773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 476/930] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:57.074135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dfe91-9bab-4e10-950d-d14e917e2cab None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.074432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dfe91-9bab-4e10-950d-d14e917e2cab None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.074713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dfe91-9bab-4e10-950d-d14e917e2cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.095827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d36dfe91-9bab-4e10-950d-d14e917e2cab None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:57.097114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d36dfe91-9bab-4e10-950d-d14e917e2cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:57.150041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:57.173108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 455/931] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:57.195625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:57.261772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:57.302166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4a41-ab8d-4eb0-8c0d-9889e0d0dca4 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.302485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4a41-ab8d-4eb0-8c0d-9889e0d0dca4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.302729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4a41-ab8d-4eb0-8c0d-9889e0d0dca4 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.306889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0774d20-8e7f-4067-82ff-e24065a88e0f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:57.310382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 456/932] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:57.313413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03b87-4ad7-4979-b99b-cba9df2ca12d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.313413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03b87-4ad7-4979-b99b-cba9df2ca12d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.313413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03b87-4ad7-4979-b99b-cba9df2ca12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.334960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-11b03b87-4ad7-4979-b99b-cba9df2ca12d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:57.336152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-11b03b87-4ad7-4979-b99b-cba9df2ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:57.358662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:57.358662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.358662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.358662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.359426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:57.359746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:57.373086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:57.374255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:57.375155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 477/933] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:57.380955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:57.466849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 457/934] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:57.485410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03b87-4ad7-4979-b99b-cba9df2ca12d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:57.496240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d83b5-3e21-48db-9cc8-5511f8f237ce None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:57.531927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:57.543526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:57.544193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.544478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.544755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.545468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:57.545773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:57.547180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:57.552491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 478/935] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:57.562080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:57.599026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03b87-4ad7-4979-b99b-cba9df2ca12d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:57.617769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:57.637795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148787b7-956f-4b0c-879b-8c9a2e39085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:57.639051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148787b7-956f-4b0c-879b-8c9a2e39085a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.639339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148787b7-956f-4b0c-879b-8c9a2e39085a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.639617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148787b7-956f-4b0c-879b-8c9a2e39085a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.640278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148787b7-956f-4b0c-879b-8c9a2e39085a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:57.641796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148787b7-956f-4b0c-879b-8c9a2e39085a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-148787b7-956f-4b0c-879b-8c9a2e39085a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:57.654286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:57.655476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:49:57.656305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:57.658979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 458/936] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:49:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:57.660459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c0292-c962-4797-9f27-33b719e99e94 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.660968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c0292-c962-4797-9f27-33b719e99e94 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.661451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c0292-c962-4797-9f27-33b719e99e94 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.662883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 459/937] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:49:57.667866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c0292-c962-4797-9f27-33b719e99e94 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:57.684058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bc1a6-6386-4e9f-a272-3d4133a7aa9e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:57.720083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625be0-1efa-4741-8d70-b2eb0aa3ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:57.720680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625be0-1efa-4741-8d70-b2eb0aa3ac1b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.720965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625be0-1efa-4741-8d70-b2eb0aa3ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.721418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625be0-1efa-4741-8d70-b2eb0aa3ac1b None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.722136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625be0-1efa-4741-8d70-b2eb0aa3ac1b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:57.722449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625be0-1efa-4741-8d70-b2eb0aa3ac1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:57.723840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625be0-1efa-4741-8d70-b2eb0aa3ac1b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:57.728382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 479/938] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:49:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:57.730194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadba532-3545-4f95-bcc3-787d64d883c0 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.730484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadba532-3545-4f95-bcc3-787d64d883c0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.730764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadba532-3545-4f95-bcc3-787d64d883c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.751065 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-cadba532-3545-4f95-bcc3-787d64d883c0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:57.752661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cadba532-3545-4f95-bcc3-787d64d883c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:57.799928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c0292-c962-4797-9f27-33b719e99e94 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:57.809180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:57.834850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 480/939] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:49:57.848774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:57.849463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:57.849750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:57.850030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:57.850760 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:57.851142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:57.853460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadba532-3545-4f95-bcc3-787d64d883c0 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:57.855126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:57.862591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 460/940] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:49:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:57.868259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:57.927419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:57.983525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadba532-3545-4f95-bcc3-787d64d883c0 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:57.995810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef22203-8e65-4f01-ba20-c4e1500d18a7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.019992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.021041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.021174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.021409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.032992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:49:58.033317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.034193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.034686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.035195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.036113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:58.036628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.038257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:49:58.041409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:58.042981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:49:58.043834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:58.047489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 461/942] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:49:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:58.048492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 481/942] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 22 08:49:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:58.049429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.055798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.102945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:58.152584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d0f6-cdf5-42fe-80b2-1811571d696f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.154960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:58.169341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010ef4b-e1a7-4d9c-b5ef-3f34ad2be121 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.187337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.187966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.188249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.188527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.189276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:58.189945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.191654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.200499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 462/943] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:58.205840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.209086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.210024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.210478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.210989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.211953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] RBAC: Adding query filter params (interface=public, service_id=80b129fda73848d8bcf44a7c1f119c82, region_id=RegionOne) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:58.212443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.214487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.220914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 482/944] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/endpoints?service_id=80b129fda73848d8bcf44a7c1f119c82&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:58.230627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.313871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bd26-4f6c-49f0-a08d-506e1caeba4d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.345913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3181af-f870-440a-9555-c5d18607cdf9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.359222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:58.368253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.369252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.369720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.370167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.381984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.384270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.384270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.384483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.384588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.384588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.385918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.387404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.400847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 483/945] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:58.403811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:58.404928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:58.405972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:58.405972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:58.405972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:58.405972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:58.408004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 463/946] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:58.416174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.522534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f135a4-4e7d-4e7d-b0f4-9d0cbc709285 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.564964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.565563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.565845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.566165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.566967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:58.567305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.568680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.582706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 484/947] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:58.589160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.612470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:58.694719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae15c8-0466-4f49-a81a-4f841e37f9b3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.729128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.729936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.730262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.730537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.738130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.739645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:58.754805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:58.755792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:58.756728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 464/948] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:58.763979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:58.796460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:58.866490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33fa71-4fe5-4b72-8f15-e941818f8af0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:58.909757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:58.910433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:58.910713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:58.911014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:58.911855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:58.912163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:58.913589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:58.933298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 485/949] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:58.938917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.023992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.046809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c49afc-abe3-4327-ba3a-d650f15d63c5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.082139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.082955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.083245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.083523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.093947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.095433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:49:59.113862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:59.114781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:59.115730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:49:59.115730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:49:59.115730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:49:59.115730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:59.115730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 465/950] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:59.122634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.218921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.228268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c4d83-1c51-40de-b2a4-8b969f80821f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.263666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fdef-2b4c-4722-84fa-8ecfebde47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.264331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fdef-2b4c-4722-84fa-8ecfebde47ce None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.264613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fdef-2b4c-4722-84fa-8ecfebde47ce None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.264888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fdef-2b4c-4722-84fa-8ecfebde47ce None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.265671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fdef-2b4c-4722-84fa-8ecfebde47ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:59.265977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fdef-2b4c-4722-84fa-8ecfebde47ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.267367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fdef-2b4c-4722-84fa-8ecfebde47ce None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.283231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 486/951] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:49:59.284864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.290226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3ca2-c34d-4478-892e-9bf2aa60f882 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.290515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3ca2-c34d-4478-892e-9bf2aa60f882 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.290790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3ca2-c34d-4478-892e-9bf2aa60f882 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.292936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 487/952] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:49:59.299281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0c68-1d81-4881-853f-e1b8dc4d4dec None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.299568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0c68-1d81-4881-853f-e1b8dc4d4dec None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.299844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0c68-1d81-4881-853f-e1b8dc4d4dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.317857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-06de0c68-1d81-4881-853f-e1b8dc4d4dec None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:59.319186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-06de0c68-1d81-4881-853f-e1b8dc4d4dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:49:59.389434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 488/953] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:49:59.404242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6bec5-1217-4531-a055-4d6b20d5e8e2 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.414352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de0c68-1d81-4881-853f-e1b8dc4d4dec None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.439313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.443463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.444527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.444981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.445486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.452995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.461082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:49:59.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:59.471353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:49:59.472531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:49:59.474679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 466/954] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:59.481553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.508023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.535485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de0c68-1d81-4881-853f-e1b8dc4d4dec None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.576835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.577650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.578033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.578426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.579273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.580796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.610772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2a511-0bc6-412e-a170-723f256edfc6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.625098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.sql.core [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:49:59.625098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 08:49:59.625098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [parameters: {'user_id': 'bf824c3a85394625b2d8929c7ef57651', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 08:49:59.625098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result.read() Jun 22 08:49:59.636241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:49:59.637320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application yield resource Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise self.value Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application session.commit() Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:49:59.638385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:49:59.639353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:49:59.642545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application result.read() Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:49:59.645127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bf824c3a85394625b2d8929c7ef57651', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:59.647800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 08:49:59.650212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 489/955] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 22 08:49:59 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:49:59.653424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.661725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.663031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.663542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.664363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.665679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:49:59.666232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.669298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.690141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 467/956] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:49:59.692480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.747998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.784751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaedbc-7eeb-4ee5-9c00-3c7aaa7b2d5d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.815292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e66f-9863-483d-bbcf-6938e47af741 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.821184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.821988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.822276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.823099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.830736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.832393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:49:59.847889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:49:59.848860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:49:59.850071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 490/957] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:49:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:49:59.855770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:49:59.858968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:49:59.865125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffa2f-2927-419b-bab5-afcf7d34b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:49:59.866698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffa2f-2927-419b-bab5-afcf7d34b500 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.867152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffa2f-2927-419b-bab5-afcf7d34b500 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.867572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffa2f-2927-419b-bab5-afcf7d34b500 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/c5e68568568447c3b5324a1e10afac02/roles/54a508762524467f8c1da2c9cb827b85` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.870690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecffa2f-2927-419b-bab5-afcf7d34b500 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=c5e68568568447c3b5324a1e10afac02, role_id=54a508762524467f8c1da2c9cb827b85)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:49:59.872599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecffa2f-2927-419b-bab5-afcf7d34b500 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:49:59.949091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 468/958] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:49:59 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/c5e68568568447c3b5324a1e10afac02/roles/54a508762524467f8c1da2c9cb827b85 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:49:59.961977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e644c1-acd7-46e2-adfb-041888498173 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.962266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e644c1-acd7-46e2-adfb-041888498173 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.962551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e644c1-acd7-46e2-adfb-041888498173 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.965109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 469/959] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:49:59.970721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600430-dd50-40c2-aacc-51a5bcc69051 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:49:59.971170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600430-dd50-40c2-aacc-51a5bcc69051 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:49:59.971615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600430-dd50-40c2-aacc-51a5bcc69051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:49:59.976750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06476-94c2-47e2-87ab-993ad65034b9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:49:59.991484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d3600430-dd50-40c2-aacc-51a5bcc69051 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:49:59.992993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d3600430-dd50-40c2-aacc-51a5bcc69051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:00.019775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c6d87-f8e4-477d-a575-dbe6e0164b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:00.020471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6d87-f8e4-477d-a575-dbe6e0164b1d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:00.020764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6d87-f8e4-477d-a575-dbe6e0164b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:00.021047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6d87-f8e4-477d-a575-dbe6e0164b1d None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:00.022658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6d87-f8e4-477d-a575-dbe6e0164b1d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:00.023006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6d87-f8e4-477d-a575-dbe6e0164b1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:00.025079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6d87-f8e4-477d-a575-dbe6e0164b1d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:00.073053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 470/960] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:49:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:00.081041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 491/961] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 22 08:49:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:00.097542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3600430-dd50-40c2-aacc-51a5bcc69051 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:00.148922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:00.217473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3600430-dd50-40c2-aacc-51a5bcc69051 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:00.255857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a3921-401b-48ca-93c3-91bce98f04b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:00.256534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3921-401b-48ca-93c3-91bce98f04b6 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:00.256828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3921-401b-48ca-93c3-91bce98f04b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:00.257107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3921-401b-48ca-93c3-91bce98f04b6 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:00.257841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a3921-401b-48ca-93c3-91bce98f04b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:00.259270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a3921-401b-48ca-93c3-91bce98f04b6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:00.366493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 471/962] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:50:00 2022] POST /identity/v3/services => generated 242 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:00.577039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5ce0-59de-459d-bb02-5b7ad266ade4 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:00.577568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5ce0-59de-459d-bb02-5b7ad266ade4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:00.577835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5ce0-59de-459d-bb02-5b7ad266ade4 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:00.580048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 492/963] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:00.585503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582312a-5c6d-4a3f-a67a-eb3ed1213590 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:00.585800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582312a-5c6d-4a3f-a67a-eb3ed1213590 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:00.586083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582312a-5c6d-4a3f-a67a-eb3ed1213590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:00.603560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e582312a-5c6d-4a3f-a67a-eb3ed1213590 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:00.605348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e582312a-5c6d-4a3f-a67a-eb3ed1213590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:00.681248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 472/964] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:00.704350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f5ce0-59de-459d-bb02-5b7ad266ade4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:00.765559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:00.808711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f5ce0-59de-459d-bb02-5b7ad266ade4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:00.843230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:00.843964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:00.844249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:00.844528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:00.845181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:00.846545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:00.859093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:00.860377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:00.861233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:00.863148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 493/965] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:50:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:00.866300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582312a-5c6d-4a3f-a67a-eb3ed1213590 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:00.893649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:00.975585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582312a-5c6d-4a3f-a67a-eb3ed1213590 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:01.018048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:01.018904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:01.019291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:01.019667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:01.020479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:01.020888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:01.022343 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:01.033310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 473/966] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:50:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:01.033481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:01.132964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead390-7e73-452d-a01f-e7802dcb6a7b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:01.157788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:01.168640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08283aa-dfe4-42d8-9f39-d43aca99019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:01.169421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08283aa-dfe4-42d8-9f39-d43aca99019c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:01.169807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08283aa-dfe4-42d8-9f39-d43aca99019c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:01.170187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08283aa-dfe4-42d8-9f39-d43aca99019c None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:01.171017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08283aa-dfe4-42d8-9f39-d43aca99019c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:01.171426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08283aa-dfe4-42d8-9f39-d43aca99019c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:01.172889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08283aa-dfe4-42d8-9f39-d43aca99019c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:01.182842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 494/967] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:50:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:01.184021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:01.272619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:01.282212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91934eb-7b7f-4323-a6e2-c32c5f2590b1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:01.316336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d9d4-ad58-4ecf-99ac-97ab963c5887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:01.317107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d9d4-ad58-4ecf-99ac-97ab963c5887 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:01.317494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d9d4-ad58-4ecf-99ac-97ab963c5887 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:01.317867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d9d4-ad58-4ecf-99ac-97ab963c5887 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:01.318730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0d9d4-ad58-4ecf-99ac-97ab963c5887 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:01.320208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0d9d4-ad58-4ecf-99ac-97ab963c5887 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:01.402923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 474/968] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:50:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:02.078721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadf3a6-b3e4-4d35-9761-a29fd7ab26e3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.079267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadf3a6-b3e4-4d35-9761-a29fd7ab26e3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.079347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadf3a6-b3e4-4d35-9761-a29fd7ab26e3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.080798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 495/969] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:02.085767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7c6d-fed3-4181-acd4-38c0483bda87 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.086164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7c6d-fed3-4181-acd4-38c0483bda87 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.086324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7c6d-fed3-4181-acd4-38c0483bda87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.103800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fadb7c6d-fed3-4181-acd4-38c0483bda87 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:02.104986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fadb7c6d-fed3-4181-acd4-38c0483bda87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:02.178739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 475/970] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:02.203604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadf3a6-b3e4-4d35-9761-a29fd7ab26e3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.304434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadf3a6-b3e4-4d35-9761-a29fd7ab26e3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.337435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43988ad-5c3a-4fb8-91d8-bb6c6919bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.338681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43988ad-5c3a-4fb8-91d8-bb6c6919bd19 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.338990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43988ad-5c3a-4fb8-91d8-bb6c6919bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.339265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43988ad-5c3a-4fb8-91d8-bb6c6919bd19 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.354861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43988ad-5c3a-4fb8-91d8-bb6c6919bd19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c43988ad-5c3a-4fb8-91d8-bb6c6919bd19 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:02.362457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:02.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:02.369180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 496/971] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:02.371490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb7c6d-fed3-4181-acd4-38c0483bda87 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.423098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5cadf-ee07-4f07-96d2-743df2f8ee94 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.423419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5cadf-ee07-4f07-96d2-743df2f8ee94 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.423664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5cadf-ee07-4f07-96d2-743df2f8ee94 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.425039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 497/972] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:02.429917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ab260-0be5-4bf4-94fe-a3281cf47e63 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.430210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ab260-0be5-4bf4-94fe-a3281cf47e63 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.430493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ab260-0be5-4bf4-94fe-a3281cf47e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.443191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:02.448381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-252ab260-0be5-4bf4-94fe-a3281cf47e63 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:02.449909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-252ab260-0be5-4bf4-94fe-a3281cf47e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:02.475652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb7c6d-fed3-4181-acd4-38c0483bda87 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.498787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:02.512858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.513655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.513939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.514212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.515013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:02.515317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.516735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.525699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 498/973] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:02.530772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 476/974] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:02.533297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ab260-0be5-4bf4-94fe-a3281cf47e63 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.550262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.645190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ab260-0be5-4bf4-94fe-a3281cf47e63 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.657148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e46a80-fb3a-4a08-8213-17198746dcb3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.680402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.681192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.681479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.682286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.692012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.692405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.692799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.693082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.693359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.693837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.693995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.695374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.697221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:02.707958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:02.708940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:02.709968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 477/975] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:02.714447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:02.715381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:02.716267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:02.716267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:02.716267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:02.716267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:02.716569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.719184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 499/976] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:02.721169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.752841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:02.821275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c4ee8-2120-4a9c-8beb-552618ba28a0 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.826323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5081ea-02b7-4c37-9db1-77da01c521bb None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.856583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.857617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.857922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.858130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.858881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:02.859181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.860797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.865056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:02.865979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:02.866083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 478/977] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:02.866168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:02.866252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:02.866999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:02.867314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:02.868664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:02.872265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.885525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 500/978] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:02.886728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:02.939066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:02.979969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879825c-ab1f-4aee-9012-e593c495a869 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:02.990124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.001087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe059-8456-4833-b406-388555daa4b0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.022184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.022938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.023177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.023456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.024171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:03.024485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.025846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.034590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 479/979] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:03.039868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.043075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.043891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.044173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.044449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.052129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.053548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:50:03.068881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:03.069854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:03.070809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 501/980] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:50:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:03.075695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.146984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f919a8-d1a8-45e8-bfc1-966e0eed72f7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.176074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.179833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3336-50ed-4c35-b787-e2665ae1a425 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.186071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.186731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.187044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.187319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.188504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] RBAC: Adding query filter params (interface=public, service_id=c4b0a7108a654f4fb661ba4364148829, region_id=RegionOne) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:03.188817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.190579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.200738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 480/981] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/endpoints?service_id=c4b0a7108a654f4fb661ba4364148829&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:03.201738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.221307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.221980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.222267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.222547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.223528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:03.223851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.225281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.243990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 502/982] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:03.249305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.260020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.311387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b95ec-6ced-4ebc-a7e8-4a1d0fb71faa None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.348525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598e49a-7703-486b-be9b-8bb4aa43f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.349533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e49a-7703-486b-be9b-8bb4aa43f2ab None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.350000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e49a-7703-486b-be9b-8bb4aa43f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.350473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e49a-7703-486b-be9b-8bb4aa43f2ab None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.351362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598e49a-7703-486b-be9b-8bb4aa43f2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.352917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598e49a-7703-486b-be9b-8bb4aa43f2ab None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.366919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c3b9b-4fcf-4745-8ebe-f7ead692bd3a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.371208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 481/983] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:03.408229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.408909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.409199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.409480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.482882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1142c-239c-4121-b147-fc6b7e5f1e09 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.483113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1142c-239c-4121-b147-fc6b7e5f1e09 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.483389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1142c-239c-4121-b147-fc6b7e5f1e09 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.484780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 482/984] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:50:03.486315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.487824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.490559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7825a-a42e-4ad1-bf80-a6b2fc6b1dd6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.490869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7825a-a42e-4ad1-bf80-a6b2fc6b1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.491176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7825a-a42e-4ad1-bf80-a6b2fc6b1dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.499415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.510494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6dd7825a-a42e-4ad1-bf80-a6b2fc6b1dd6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:03.511950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6dd7825a-a42e-4ad1-bf80-a6b2fc6b1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:03.568199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.588800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 483/985] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:03.599807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 503/986] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:03.605481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7825a-a42e-4ad1-bf80-a6b2fc6b1dd6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.612471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.718329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7825a-a42e-4ad1-bf80-a6b2fc6b1dd6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.723566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b5a1-fd5e-40fd-8eb3-2f04502ad32a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.734563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.753453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.754244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.754547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.754885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.761321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.762240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.762523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.762802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.763591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.764954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.765914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.767385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:03.778639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:03.779812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:03.780652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:03.783158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 504/987] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:03.785071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:03.785941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:03.786843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:03.786843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:03.786843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:03.786843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:03.787088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.787165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 484/988] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:03.791592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.827209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:03.893032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677454ef-a138-4c8a-9772-004d9fb25ef2 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.898203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29791e2-d262-4970-b58f-2c3f27c6a629 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:03.929606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.930269 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.930555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.930851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.931561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:03.932437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.933808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.934723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:03.935415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:03.935803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:03.936082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:03.936798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:03.937106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:03.938518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:03.939343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 505/989] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:03.944651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.955049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 485/990] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:03.956263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:03.987388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:04.058325 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6d705-3e9b-4472-9a0e-db9c389b21e6 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.060214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:04.067338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077060-98cd-4ad5-b647-fd501c2b1e6e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.095857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.096533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.096822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.097103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.097806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:04.098117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.099506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.104147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.109312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 506/991] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:04.109454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.109454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.109454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.110453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.115866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.117304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:50:04.134000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:04.135785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:04.137138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 486/992] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:04.141808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.216011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:04.220027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec52b9d-49db-47ce-9ded-73c43e6ab9ca None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.250359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b79da-4ecd-4643-97dc-5fe7891d80b5 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.255786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.256446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.256730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.257006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.257799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] RBAC: Adding query filter params (interface=admin, service_id=80b129fda73848d8bcf44a7c1f119c82, region_id=RegionOne) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:04.258109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.260486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.266389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 507/993] 10.222.0.55 () {56 vars in 1249 bytes} [Wed Jun 22 08:50:04 2022] GET /identity/v3/endpoints?service_id=80b129fda73848d8bcf44a7c1f119c82&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:04.271581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.288853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.289611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.289808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.290065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.290868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:04.291787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.293125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.305755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 487/994] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:04.311907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:04.330595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:04.386461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549a7e-736b-43ea-b6a1-893d4b3f8e12 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.419632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898582-966a-435a-a763-b8bad2f51b8c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:04.423889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c25d9-46de-4ab9-966b-e37111fb2c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.424792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c25d9-46de-4ab9-966b-e37111fb2c48 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.425309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c25d9-46de-4ab9-966b-e37111fb2c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.425793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c25d9-46de-4ab9-966b-e37111fb2c48 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.426800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c25d9-46de-4ab9-966b-e37111fb2c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.428286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c25d9-46de-4ab9-966b-e37111fb2c48 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.435776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 508/995] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:50:04 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:50:04.459957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2b264-1eb3-44d8-9685-745c4fa755f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:04.460645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b264-1eb3-44d8-9685-745c4fa755f6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:04.460930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b264-1eb3-44d8-9685-745c4fa755f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:04.461211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b264-1eb3-44d8-9685-745c4fa755f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:04.462122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2b264-1eb3-44d8-9685-745c4fa755f6 None admin] RBAC: Adding query filter params (role.id=54a508762524467f8c1da2c9cb827b85, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=c5e68568568447c3b5324a1e10afac02) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:04.462439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2b264-1eb3-44d8-9685-745c4fa755f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:04.464887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2b264-1eb3-44d8-9685-745c4fa755f6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:04.471950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 488/996] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:04 2022] GET /identity/v3/role_assignments?user.id=c5e68568568447c3b5324a1e10afac02&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=54a508762524467f8c1da2c9cb827b85 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:05.431079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0be-3ab1-49d3-8839-c1dcb02404ca None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.431611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0be-3ab1-49d3-8839-c1dcb02404ca None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.431701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0be-3ab1-49d3-8839-c1dcb02404ca None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.433196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 509/997] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:05.438032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b83da-5a82-43fe-8efe-9587cbaf0f99 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.438419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b83da-5a82-43fe-8efe-9587cbaf0f99 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.438592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b83da-5a82-43fe-8efe-9587cbaf0f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.454997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-266b83da-5a82-43fe-8efe-9587cbaf0f99 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:05.456180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-266b83da-5a82-43fe-8efe-9587cbaf0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:05.523743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 489/998] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:05.547880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede0be-3ab1-49d3-8839-c1dcb02404ca None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.576711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:05.653983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede0be-3ab1-49d3-8839-c1dcb02404ca None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.687395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.688177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.688463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.688741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.689384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.690740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:05.702313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:05.703366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:50:05.704244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:05.711384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 510/999] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:50:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:05.711508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b83da-5a82-43fe-8efe-9587cbaf0f99 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.721709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:05.808819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b83da-5a82-43fe-8efe-9587cbaf0f99 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.842849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.843526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.843814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.844096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.844807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:05.845118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.846476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:05.851368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 490/1000] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:50:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:05.856813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:05.948612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:05.957715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f841-5af0-4274-8c49-f854a0b0ac8c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:05.992515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab5330-a819-45aa-8b54-c19014423f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:05.993183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5330-a819-45aa-8b54-c19014423f27 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:05.993470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5330-a819-45aa-8b54-c19014423f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:05.993751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5330-a819-45aa-8b54-c19014423f27 None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:05.994496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5330-a819-45aa-8b54-c19014423f27 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:05.994808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5330-a819-45aa-8b54-c19014423f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:05.996194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5330-a819-45aa-8b54-c19014423f27 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.007305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 511/1001] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 22 08:50:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:06.007451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.085520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:06.110867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befb06f-45ce-4b29-bf27-a413327f7727 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.146355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6508900-bf21-404a-a3bb-16b20662c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.147044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508900-bf21-404a-a3bb-16b20662c8e8 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.147334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508900-bf21-404a-a3bb-16b20662c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.147613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508900-bf21-404a-a3bb-16b20662c8e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.148354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6508900-bf21-404a-a3bb-16b20662c8e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.149713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6508900-bf21-404a-a3bb-16b20662c8e8 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.268967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 491/1002] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:50:06.480057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86019-3f2d-4bb3-acad-d602642560c6 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.480570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86019-3f2d-4bb3-acad-d602642560c6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.480681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86019-3f2d-4bb3-acad-d602642560c6 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.481976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 512/1003] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:06.487792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d440-0e6d-4bd3-8013-2389adfe9457 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.488211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d440-0e6d-4bd3-8013-2389adfe9457 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.488353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d440-0e6d-4bd3-8013-2389adfe9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.506042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-56e6d440-0e6d-4bd3-8013-2389adfe9457 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:06.507268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-56e6d440-0e6d-4bd3-8013-2389adfe9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.551203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06446c-0a30-40be-891b-2b6109e2e2c1 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.551426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06446c-0a30-40be-891b-2b6109e2e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.551713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06446c-0a30-40be-891b-2b6109e2e2c1 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.553468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 513/1004] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:50:06.560082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2461bc3-482f-44a8-b9d3-6c580a039d6e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.560599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2461bc3-482f-44a8-b9d3-6c580a039d6e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.561193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2461bc3-482f-44a8-b9d3-6c580a039d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.581890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b2461bc3-482f-44a8-b9d3-6c580a039d6e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:06.583441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b2461bc3-482f-44a8-b9d3-6c580a039d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:06.583830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 492/1005] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:06.607322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6d440-0e6d-4bd3-8013-2389adfe9457 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.655720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 514/1006] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:06 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:06.672202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:06.678276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2461bc3-482f-44a8-b9d3-6c580a039d6e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.716511 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6d440-0e6d-4bd3-8013-2389adfe9457 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.753967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.755183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.755468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.755756 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.757087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.757766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:06.769830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:06.770813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:50:06.771698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:06.774237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:06.776100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 493/1007] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:06.776957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.791973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2461bc3-482f-44a8-b9d3-6c580a039d6e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.831528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.832352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.832639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.832920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] PATH_INFO: `/v3/services/image` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.833571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.835058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:06.847538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:06.848773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:06.849958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 515/1008] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:06.854855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.887130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce0d0-295d-4aad-add9-c825125552a6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:06.908203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:06.923472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:06.924138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:06.924421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:06.924695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:06.925395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:06.925702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:06.927074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:06.936384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 494/1009] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:06.937421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:06.964653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ef90-0dea-4543-98fd-4150ea87730a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.001398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.002097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.002387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.002665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.003409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] RBAC: Adding query filter params (name=image) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:07.003719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.005089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.014655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 516/1010] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:07.015603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.032568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:07.045526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb2e8-48b4-47b9-84b7-8da7fa353126 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.079851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.080862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.081145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.081420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.082181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:07.082432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.083821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.089353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 495/1011] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 22 08:50:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:07.094562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:07.121642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc5c5-b8ba-4cbe-b9be-192dc94f9edf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.144398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:07.158528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f377e-7399-4a56-89ab-c2658a5d090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.159221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f377e-7399-4a56-89ab-c2658a5d090b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.159504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f377e-7399-4a56-89ab-c2658a5d090b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.159786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f377e-7399-4a56-89ab-c2658a5d090b None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.160484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f377e-7399-4a56-89ab-c2658a5d090b None admin] RBAC: Adding query filter params (type=image) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:07.160790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f377e-7399-4a56-89ab-c2658a5d090b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.162137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f377e-7399-4a56-89ab-c2658a5d090b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.167473 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 517/1012] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:07.201868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd7b8-3b23-496b-8c79-b79b56e80c05 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:07.239409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6def7a3-d131-425e-be06-254126ebd4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:07.240087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6def7a3-d131-425e-be06-254126ebd4ba None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:07.240368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6def7a3-d131-425e-be06-254126ebd4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:07.240642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6def7a3-d131-425e-be06-254126ebd4ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:07.241388 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6def7a3-d131-425e-be06-254126ebd4ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:07.242765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6def7a3-d131-425e-be06-254126ebd4ba None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:07.319400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 496/1013] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:50:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:50:08.412929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7634-0154-4257-b6d7-dc3c7caf74d8 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.413461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7634-0154-4257-b6d7-dc3c7caf74d8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.413550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7634-0154-4257-b6d7-dc3c7caf74d8 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:08.414953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 518/1014] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:08.420814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd518-01a1-43e1-9a0c-0d18b47a0bc1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.421217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd518-01a1-43e1-9a0c-0d18b47a0bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.421449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd518-01a1-43e1-9a0c-0d18b47a0bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:08.439967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f9cbd518-01a1-43e1-9a0c-0d18b47a0bc1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:08.441187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f9cbd518-01a1-43e1-9a0c-0d18b47a0bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:08.516920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 497/1015] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:08.539775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd7634-0154-4257-b6d7-dc3c7caf74d8 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:08.623217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:08.645681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd7634-0154-4257-b6d7-dc3c7caf74d8 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:08.679438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:08.680239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.680520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.680792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:08.691415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:08.699962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:08.700880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:08.706723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 519/1016] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 22 08:50:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:08.708826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbd518-01a1-43e1-9a0c-0d18b47a0bc1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:08.743147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:08.811061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbd518-01a1-43e1-9a0c-0d18b47a0bc1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:08.844279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:08.844948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.845231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.845509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:08.846280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:08.846591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:08.847999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:08.856748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 498/1017] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 22 08:50:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:08.862453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:08.962542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34ee0e-1ae6-4745-a0f3-c8390eec0656 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:08.997379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:08.998176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:08.998458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:08.998734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.006509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.010853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.012295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:09.029037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:09.029951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:09.031428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:09.031428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:09.031428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:09.031428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:09.034860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 520/1018] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:09.036059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.133008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.139317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f800c2b-390d-471f-9772-ec6a9917a93c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.173522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114f7c5-1cc4-408e-b2a0-e54f1684ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.174194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114f7c5-1cc4-408e-b2a0-e54f1684ab2d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.174478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114f7c5-1cc4-408e-b2a0-e54f1684ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.174750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114f7c5-1cc4-408e-b2a0-e54f1684ab2d None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.175502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114f7c5-1cc4-408e-b2a0-e54f1684ab2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:09.175811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114f7c5-1cc4-408e-b2a0-e54f1684ab2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.177175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114f7c5-1cc4-408e-b2a0-e54f1684ab2d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.188664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 499/1019] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:09.193945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.215124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b097b-d0b2-498b-9d37-a60ed8719d82 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.215353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b097b-d0b2-498b-9d37-a60ed8719d82 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.215645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b097b-d0b2-498b-9d37-a60ed8719d82 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.217166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 500/1020] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:50:09.222170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e14a-e8e8-4147-a4ea-41a98a512066 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.222462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e14a-e8e8-4147-a4ea-41a98a512066 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.222745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e14a-e8e8-4147-a4ea-41a98a512066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.240806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-31b8e14a-e8e8-4147-a4ea-41a98a512066 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:09.242063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-31b8e14a-e8e8-4147-a4ea-41a98a512066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:09.301294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666e5a-484b-4b07-b44f-203c9bec2965 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.313713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 501/1021] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:09 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:09.336969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8e14a-e8e8-4147-a4ea-41a98a512066 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.341068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.342122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.342413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.342697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.351834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.354278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:50:09.369971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:09.371222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:09.372759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 521/1022] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:50:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:09.376855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.427411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.435255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.449542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8e14a-e8e8-4147-a4ea-41a98a512066 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.475511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dcd7e-4e7c-4bb0-ae57-85c397b56f7d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.482900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee4958-ec36-4c12-a4a9-b95a4aa55854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.483561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4958-ec36-4c12-a4a9-b95a4aa55854 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.483847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4958-ec36-4c12-a4a9-b95a4aa55854 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.484129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4958-ec36-4c12-a4a9-b95a4aa55854 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.484844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee4958-ec36-4c12-a4a9-b95a4aa55854 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.486470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee4958-ec36-4c12-a4a9-b95a4aa55854 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.508730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3f5ca-9df0-43b5-a105-e2f6fa97e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.509385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f5ca-9df0-43b5-a105-e2f6fa97e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.509695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f5ca-9df0-43b5-a105-e2f6fa97e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.509973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f5ca-9df0-43b5-a105-e2f6fa97e4f8 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.510804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3f5ca-9df0-43b5-a105-e2f6fa97e4f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:09.511162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3f5ca-9df0-43b5-a105-e2f6fa97e4f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.512561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3f5ca-9df0-43b5-a105-e2f6fa97e4f8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.529394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 522/1023] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:50:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:09.530601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf057dbe-319b-470f-a796-2d9dda409a92 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.530916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf057dbe-319b-470f-a796-2d9dda409a92 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.531199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf057dbe-319b-470f-a796-2d9dda409a92 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.536460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 523/1024] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:09.536460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf057dbe-319b-470f-a796-2d9dda409a92 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.574865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 502/1025] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:50:09 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:09.574865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e42f1-10f6-4822-8485-ad8fd4177b77 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.574865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e42f1-10f6-4822-8485-ad8fd4177b77 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.574865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e42f1-10f6-4822-8485-ad8fd4177b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.588874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-675e42f1-10f6-4822-8485-ad8fd4177b77 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:09.590254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-675e42f1-10f6-4822-8485-ad8fd4177b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:09.657815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf057dbe-319b-470f-a796-2d9dda409a92 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.661928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.667643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 503/1026] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:09.691465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e42f1-10f6-4822-8485-ad8fd4177b77 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.695058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.695729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.696018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.696297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.778453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.778632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.780287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.800592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e42f1-10f6-4822-8485-ad8fd4177b77 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.839005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:09.840011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:09.840401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:09.840752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:09.841947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:09.843465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:09.845085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 504/1027] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:09.852139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.890858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 524/1028] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:09.893946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:09.897556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:09.966647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4750e-9c97-4706-ac68-df34ffff7653 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:09.994997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2fbcd-4430-4920-af0d-760093bf1691 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.003823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.004667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.005195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.005629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.006498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.008335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.023632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:10.034368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.034368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.034368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.034368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.041181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.042628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:10.059634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:10.063620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:10.064518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:10.064518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:10.064518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:10.064518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:10.064518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 525/1029] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:10.066357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.117223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 505/1030] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:50:09 2022] POST /identity/v3/projects => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:10.127851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:10.168600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46fce8-a5ee-4291-ab06-b25f343862d9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.205015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.205704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.206029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.206343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.207546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:10.208218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.210405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.224523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 526/1031] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:10.229481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.341832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73b50-62ce-4ada-b105-819e66cc1c13 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.377508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.378319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.378607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.378912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.385983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.387478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:50:10.401533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:10.402424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:10.403339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 506/1032] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:10.408721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.512521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e9f8-7304-4501-9d45-6b404bf3977f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.529439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:10.548237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb67a2-714d-49f5-9b16-a425f64b6a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.548926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb67a2-714d-49f5-9b16-a425f64b6a37 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.549253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb67a2-714d-49f5-9b16-a425f64b6a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.549575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb67a2-714d-49f5-9b16-a425f64b6a37 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.550396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb67a2-714d-49f5-9b16-a425f64b6a37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:10.550747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb67a2-714d-49f5-9b16-a425f64b6a37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.552370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb67a2-714d-49f5-9b16-a425f64b6a37 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.569781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 527/1033] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:10.571012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:10.631051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:10.676643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e93cb-e360-4538-b48e-2a1c12a0d942 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:10.727959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fce5c-ed80-4b6a-a1b3-b28f9939a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:10.729273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fce5c-ed80-4b6a-a1b3-b28f9939a599 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:10.729556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fce5c-ed80-4b6a-a1b3-b28f9939a599 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:10.729831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fce5c-ed80-4b6a-a1b3-b28f9939a599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:10.730661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fce5c-ed80-4b6a-a1b3-b28f9939a599 None admin] RBAC: Adding query filter params (role.id=54a508762524467f8c1da2c9cb827b85, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=4c0cbf8022ee4c37a591ee578b53806c) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:10.731004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fce5c-ed80-4b6a-a1b3-b28f9939a599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:10.732421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fce5c-ed80-4b6a-a1b3-b28f9939a599 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:10.738499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 507/1034] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:10 2022] GET /identity/v3/role_assignments?user.id=4c0cbf8022ee4c37a591ee578b53806c&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=54a508762524467f8c1da2c9cb827b85 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:11.659151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84fb7e-bd50-4fce-917d-96ebc2e9117b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:11.659640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84fb7e-bd50-4fce-917d-96ebc2e9117b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:11.659640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84fb7e-bd50-4fce-917d-96ebc2e9117b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:11.661051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 528/1035] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:11.666234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80986a-eb81-4c55-be69-8c8008ec0e2d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:11.666608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80986a-eb81-4c55-be69-8c8008ec0e2d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:11.666801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80986a-eb81-4c55-be69-8c8008ec0e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:11.684161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-5f80986a-eb81-4c55-be69-8c8008ec0e2d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:11.685348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5f80986a-eb81-4c55-be69-8c8008ec0e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:11.754872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 508/1036] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:11.778382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84fb7e-bd50-4fce-917d-96ebc2e9117b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:11.885964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84fb7e-bd50-4fce-917d-96ebc2e9117b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:11.920299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:11.921096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:11.921382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:11.921660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] PATH_INFO: `/v3/services/image` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:11.922306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:11.923707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:11.935711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:11.936707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:11.942797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 529/1037] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 22 08:50:11 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:11.945349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80986a-eb81-4c55-be69-8c8008ec0e2d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:11.996787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:12.046309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80986a-eb81-4c55-be69-8c8008ec0e2d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:12.080261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ccacb-4507-4a94-9e85-c194a3a970a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:12.080924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ccacb-4507-4a94-9e85-c194a3a970a6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.081211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ccacb-4507-4a94-9e85-c194a3a970a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.081493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ccacb-4507-4a94-9e85-c194a3a970a6 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.082209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ccacb-4507-4a94-9e85-c194a3a970a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:12.082520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ccacb-4507-4a94-9e85-c194a3a970a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:12.083909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ccacb-4507-4a94-9e85-c194a3a970a6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:12.088928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 509/1038] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:12.094564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:12.139522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:12.190349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f726-9204-4a61-9bcb-0e2b53eab701 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.190543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f726-9204-4a61-9bcb-0e2b53eab701 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.190816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f726-9204-4a61-9bcb-0e2b53eab701 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.192226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 510/1039] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:50:12.197795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c25687-8886-41ff-964f-99abe1719940 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.197995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd3772-fec2-4246-a707-7cd1e9c6e31a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:12.198452 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c25687-8886-41ff-964f-99abe1719940 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.199059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c25687-8886-41ff-964f-99abe1719940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.221124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-82c25687-8886-41ff-964f-99abe1719940 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:12.222888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-82c25687-8886-41ff-964f-99abe1719940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:12.238138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:12.238803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.239124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.239399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.240104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] RBAC: Adding query filter params (type=image) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:12.240622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:12.241758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:12.246804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 530/1040] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:12.252307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:12.299025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 511/1041] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:12.324012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c25687-8886-41ff-964f-99abe1719940 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:12.357302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec456f-b9e6-4ef6-8194-62506d4d236a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:12.360723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:12.384142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:12.393374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:12.394036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.394317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.394615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.395418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] RBAC: Adding query filter params (interface=public, service_id=776f0909303f4ac18a9b979fcc4c241f, region_id=RegionOne) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:12.397972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:12.397972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:12.404171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 531/1042] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:50:12 2022] GET /identity/v3/endpoints?service_id=776f0909303f4ac18a9b979fcc4c241f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:12.409440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:12.443684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c25687-8886-41ff-964f-99abe1719940 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:12.481659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:12.482457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.482741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.483682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.484315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:12.485991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:12.487840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 512/1043] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:12.493328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:12.514665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec225e-ddfc-477c-b05a-225f5b76dbf9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:12.551236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1fcc4-3dd9-4bc9-9d6a-6a5487b40cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:12.551903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1fcc4-3dd9-4bc9-9d6a-6a5487b40cce None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.552190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1fcc4-3dd9-4bc9-9d6a-6a5487b40cce None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.552471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1fcc4-3dd9-4bc9-9d6a-6a5487b40cce None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.553153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1fcc4-3dd9-4bc9-9d6a-6a5487b40cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:12.554516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1fcc4-3dd9-4bc9-9d6a-6a5487b40cce None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:12.570907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 532/1044] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:50:12 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:50:12.612304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db451-15e9-4c12-8836-839d5998e72e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:12.628341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:12.653588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452f2f-0097-4895-a73a-c98bce052698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:12.654271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452f2f-0097-4895-a73a-c98bce052698 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.654553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452f2f-0097-4895-a73a-c98bce052698 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.654841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452f2f-0097-4895-a73a-c98bce052698 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.655648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452f2f-0097-4895-a73a-c98bce052698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:12.657269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452f2f-0097-4895-a73a-c98bce052698 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:12.760440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 513/1045] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:50:12 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:50:12.782491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5fd0-1614-49e8-a61b-fe718a771c42 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.783097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5fd0-1614-49e8-a61b-fe718a771c42 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.783453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5fd0-1614-49e8-a61b-fe718a771c42 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.785012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 533/1046] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:12.791114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9c355-eb88-46a4-a150-bba0ffe6624c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:12.791433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9c355-eb88-46a4-a150-bba0ffe6624c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:12.791676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9c355-eb88-46a4-a150-bba0ffe6624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:12.809171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-99f9c355-eb88-46a4-a150-bba0ffe6624c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:12.810398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-99f9c355-eb88-46a4-a150-bba0ffe6624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:12.885927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 514/1047] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:12.909046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5fd0-1614-49e8-a61b-fe718a771c42 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:12.941549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:13.023744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5fd0-1614-49e8-a61b-fe718a771c42 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:13.059527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:13.060337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:13.060624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:13.060902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:13.071332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:13.079976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:13.080916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:13.081857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 534/1048] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 22 08:50:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:13.087162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9c355-eb88-46a4-a150-bba0ffe6624c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:13.182525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:13.186956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9c355-eb88-46a4-a150-bba0ffe6624c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:13.221208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:13.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:13.222145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:13.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:13.223192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:13.223497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:13.226593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:13.237677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 515/1049] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 22 08:50:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:13.239094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:13.331124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:13.340225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb5fa-7045-4814-b9c9-cb531383f165 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:13.381050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:13.382116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:13.382392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:13.382669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:13.392494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:13.393933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:13.410751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:13.411748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:13.418141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:13.418141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:13.418141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:13.418141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:13.418141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 535/1050] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:13.418424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:13.516436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e7d29-cd33-4994-8c90-dd7226c0661f None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:13.549601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:13.550261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:13.550542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:13.550907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:13.551629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:13.551975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:13.553321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:13.570188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 516/1051] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:13.580770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:13.671850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d54a0-3281-4811-b89b-0918dc3131d4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:13.707359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:13.708141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:13.708423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:13.708700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:13.716247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:13.717664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:50:13.732172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:13.733130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:13.739453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 536/1052] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:50:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:13.740076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:13.761328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:13.838672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53e14c-8240-4492-b164-85a160770682 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:13.872622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:13.873285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:13.873564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:13.873839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:13.874667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:13.875000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:13.876413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:13.893068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 517/1053] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:50:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:13.898370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:13.903231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:14.001036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd529c-7197-494b-be65-755b89e1aa82 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:14.033858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:14.034644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.034952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.035235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.046259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:14.047703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:14.064130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:14.065053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:14.065964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:14.065964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:14.065964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:14.065964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:14.067171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 537/1054] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:14.070854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:14.147684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:14.169663 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2bf18-d529-45df-a99f-da13d6e4e3ff None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:14.203425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:14.204163 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.204517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.204851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.205635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:14.206006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:14.207456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:14.222897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 518/1055] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:14.224282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:14.280420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:14.326423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699604-e186-441b-a2d1-3b988cc4b936 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:14.365783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:14.366590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.366918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.367201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.374920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:14.376383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:50:14.390674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:14.391660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:14.392571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:14.393555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 538/1056] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:14.397667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:14.499658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0642-899d-4d9a-8b1b-ec3973e858ad None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:14.532726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b4462-9d5f-473a-818d-162285b76a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:14.533441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b4462-9d5f-473a-818d-162285b76a90 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.533822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b4462-9d5f-473a-818d-162285b76a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.534193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b4462-9d5f-473a-818d-162285b76a90 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.535103 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b4462-9d5f-473a-818d-162285b76a90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:14.535519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b4462-9d5f-473a-818d-162285b76a90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:14.537033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b4462-9d5f-473a-818d-162285b76a90 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:14.544802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:14.554867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 519/1057] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:14.556700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:14.618898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dfa00-43a9-48f0-9fb2-2df4217956b0 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.619266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dfa00-43a9-48f0-9fb2-2df4217956b0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.619488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dfa00-43a9-48f0-9fb2-2df4217956b0 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.620860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 520/1058] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:50:14.626293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4022a16-3636-445e-a813-40c00a9fba58 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.627160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4022a16-3636-445e-a813-40c00a9fba58 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.627540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4022a16-3636-445e-a813-40c00a9fba58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.644157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a4022a16-3636-445e-a813-40c00a9fba58 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:14.645451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a4022a16-3636-445e-a813-40c00a9fba58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:14.660638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773ece-c513-4eff-aa23-73a6458acb5e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:14.677517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:14.695739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306d88-cb80-4578-a362-819437443d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:14.696763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306d88-cb80-4578-a362-819437443d51 None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.697112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306d88-cb80-4578-a362-819437443d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.697529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306d88-cb80-4578-a362-819437443d51 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/4c0cbf8022ee4c37a591ee578b53806c/roles/54a508762524467f8c1da2c9cb827b85` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.699833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d306d88-cb80-4578-a362-819437443d51 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=4c0cbf8022ee4c37a591ee578b53806c, role_id=54a508762524467f8c1da2c9cb827b85)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:14.701350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d306d88-cb80-4578-a362-819437443d51 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:14.718032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 521/1059] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:14.741821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4022a16-3636-445e-a813-40c00a9fba58 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:14.768836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 539/1060] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:50:14 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/4c0cbf8022ee4c37a591ee578b53806c/roles/54a508762524467f8c1da2c9cb827b85 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:14.850567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4022a16-3636-445e-a813-40c00a9fba58 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:14.879191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:14.881256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba749b-d8d1-46f1-ab4a-dec0d8479156 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.881555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba749b-d8d1-46f1-ab4a-dec0d8479156 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.881840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba749b-d8d1-46f1-ab4a-dec0d8479156 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.883425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 540/1061] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:50:14.888599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:14.889414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.889702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.889799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194daa7-20c7-4ceb-bfd0-6f4039709ea7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:14.889980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.890075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194daa7-20c7-4ceb-bfd0-6f4039709ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:14.890259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194daa7-20c7-4ceb-bfd0-6f4039709ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:14.890647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:14.892068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:14.906573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:14.907788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:50:14.908672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:14.909407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5194daa7-20c7-4ceb-bfd0-6f4039709ea7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:14.909812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5194daa7-20c7-4ceb-bfd0-6f4039709ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:14.917317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 522/1062] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 22 08:50:14 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:14.918308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:14.995288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 541/1063] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:15.019171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194daa7-20c7-4ceb-bfd0-6f4039709ea7 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.038076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4feded-59f6-4bc8-b725-fa15a08a88f1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.074162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.074846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.075165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.075423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.076126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] RBAC: Adding query filter params (name=image) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:15.076458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:15.077804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:15.082794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 523/1064] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:15.088839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.131196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194daa7-20c7-4ceb-bfd0-6f4039709ea7 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.140486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:15.146369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:15.174093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.175024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.175658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.176139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.187481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:15.193920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322a841-5c37-4c8a-86bd-be3e1f62d018 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:15.195087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:15.196215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:15.197893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:15.201625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 542/1065] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:50:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:15.202574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.234531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.235500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.235812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.236084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.236775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] RBAC: Adding query filter params (type=image) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:15.237086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:15.238529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:15.244765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 524/1066] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:15.249863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.313398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fadb0-b72b-4164-8f80-4d08a2fccd94 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.352593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.353342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.353626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.353900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.354640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:15.354971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:15.356340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:15.360466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89e56b-13f9-4e5d-ac32-a99bc7032957 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.365138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 543/1067] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:15.371266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.382971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:15.397817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.398540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.398848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.399137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.399963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:15.401338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:15.401554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:15.470188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be53026-6e1f-4349-8d8f-78ca15aa9458 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.504478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 525/1068] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:50:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:15.517355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.518346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.518630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.518943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] PATH_INFO: `/v3/users/64704e37984f478a9951e90491fb8d72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.535240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] RBAC: Authorizing `identity:get_user(user_id=64704e37984f478a9951e90491fb8d72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:15.536783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:15.538838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 544/1069] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:15 2022] GET /identity/v3/users/64704e37984f478a9951e90491fb8d72 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:15.544820 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.656071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe079-fdb9-41f3-8984-def99e43d62e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:15.692654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:15.693448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:15.693811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:15.694092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:15.740946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:15.763281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:15.764759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:15.871458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 526/1070] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:15.877421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:15.960629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:15.980310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218fa2f-c74e-410a-b7e0-7c13518d3daa None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:16.015741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb435a-da58-46ef-a2d7-676eb4c8d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:16.016600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb435a-da58-46ef-a2d7-676eb4c8d31a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:16.016882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb435a-da58-46ef-a2d7-676eb4c8d31a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:16.017158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb435a-da58-46ef-a2d7-676eb4c8d31a None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:16.018320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb435a-da58-46ef-a2d7-676eb4c8d31a None admin] RBAC: Authorizing `identity:get_project(project_id=88667c70bfcb44c7978e1c6d6993b252)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:16.019763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb435a-da58-46ef-a2d7-676eb4c8d31a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:16.021631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 545/1071] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:15 2022] GET /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:16.027926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:16.105420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:16.128160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314ba2-ab6a-44f7-b54f-b210e66ab4e1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:16.164239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338df612-3d0c-47ef-853c-4987eb1d60d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:16.165281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338df612-3d0c-47ef-853c-4987eb1d60d0 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:16.166325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338df612-3d0c-47ef-853c-4987eb1d60d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:16.166807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338df612-3d0c-47ef-853c-4987eb1d60d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:16.167969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338df612-3d0c-47ef-853c-4987eb1d60d0 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=88667c70bfcb44c7978e1c6d6993b252, user.id=64704e37984f478a9951e90491fb8d72) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:16.168502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338df612-3d0c-47ef-853c-4987eb1d60d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:16.170158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338df612-3d0c-47ef-853c-4987eb1d60d0 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:16.176305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 527/1072] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:16 2022] GET /identity/v3/role_assignments?user.id=64704e37984f478a9951e90491fb8d72&scope.project.id=88667c70bfcb44c7978e1c6d6993b252&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:16.805077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f7fa0-0494-42ef-b22a-14b47b4313b3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:16.805457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f7fa0-0494-42ef-b22a-14b47b4313b3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:16.805659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f7fa0-0494-42ef-b22a-14b47b4313b3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:16.807609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 546/1073] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:16.812633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34407-c331-4b96-a497-504503fe896a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:16.812924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34407-c331-4b96-a497-504503fe896a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:16.813206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34407-c331-4b96-a497-504503fe896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:16.830797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-67d34407-c331-4b96-a497-504503fe896a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:16.832016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-67d34407-c331-4b96-a497-504503fe896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:16.900224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 528/1074] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:16.923163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f7fa0-0494-42ef-b22a-14b47b4313b3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.024005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f7fa0-0494-42ef-b22a-14b47b4313b3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:17.066993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:17.067719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.068002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.068276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.078833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:17.086737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:17.088320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:50:17.089189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:17.091167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 547/1075] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 22 08:50:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:17.094379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34407-c331-4b96-a497-504503fe896a None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.165783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:17.195498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34407-c331-4b96-a497-504503fe896a None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:17.231222 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:17.231898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.232184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.232462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.233227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:17.233515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:17.235173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:17.248051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 529/1076] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 22 08:50:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:17.249355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.264033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:17.358981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ae3df-6490-4a97-94dc-2bbc3a1fc1e4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:17.393607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404487a-6540-41d4-bf4e-154014d950d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:17.394387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404487a-6540-41d4-bf4e-154014d950d2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.394670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404487a-6540-41d4-bf4e-154014d950d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.394976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404487a-6540-41d4-bf4e-154014d950d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.406059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404487a-6540-41d4-bf4e-154014d950d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:17.407517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404487a-6540-41d4-bf4e-154014d950d2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f404487a-6540-41d4-bf4e-154014d950d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:17.424254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:17.425186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:17.426104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:17.426104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:17.426104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:17.426104 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:17.427143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 548/1077] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:17.431614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.533140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe371e-8829-4a0e-83ab-7b91d74039e6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:17.562301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:17.568054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:17.568773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.569061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.569340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.570069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:17.570378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:17.572360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:17.584060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 530/1078] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:17.588362 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60985-5e09-45e4-b2af-b071cf036a92 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.588607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60985-5e09-45e4-b2af-b071cf036a92 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.588894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60985-5e09-45e4-b2af-b071cf036a92 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.589478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.590972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 549/1079] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:17.595974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a871f-1c89-4742-8bd3-4713348ab08d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.596265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a871f-1c89-4742-8bd3-4713348ab08d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.596541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a871f-1c89-4742-8bd3-4713348ab08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.614753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7c1a871f-1c89-4742-8bd3-4713348ab08d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:17.616421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7c1a871f-1c89-4742-8bd3-4713348ab08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:17.679633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:17.692478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 550/1080] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:17.694719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b45ad-39f5-477a-b424-28c97854612a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:17.715656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a871f-1c89-4742-8bd3-4713348ab08d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.732345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:17.733131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.733412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.733686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.741987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:17.744198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:50:17.758955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:17.760486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:17.761503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 531/1081] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 22 08:50:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:17.766416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.821934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:17.822131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a871f-1c89-4742-8bd3-4713348ab08d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:17.858808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:17.859489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.860029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.860309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.870772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e14e7-9f70-4306-a412-041d7bb3136a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:17.905029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:17.905755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:17.905970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:17.906249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:17.907109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:17.907421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:17.908824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:17.920240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:17.932629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 532/1082] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 22 08:50:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:17.933778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:17.935554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:17.937084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.034501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14398-8ada-44c2-b35b-934465e70ad3 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.038942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 551/1083] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:18.045131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.046461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.070195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2893eb-33c3-416f-885f-7149fa753aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.070879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2893eb-33c3-416f-885f-7149fa753aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.071171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2893eb-33c3-416f-885f-7149fa753aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.071970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2893eb-33c3-416f-885f-7149fa753aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.142785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2893eb-33c3-416f-885f-7149fa753aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.144348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2893eb-33c3-416f-885f-7149fa753aa7 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.147837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.156921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a12d7-786e-46bc-9a24-42a0c60bd021 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.192301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5ce44-b6b8-45d9-846d-e64165d09bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.193089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ce44-b6b8-45d9-846d-e64165d09bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.193645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ce44-b6b8-45d9-846d-e64165d09bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.193645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ce44-b6b8-45d9-846d-e64165d09bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.203387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5ce44-b6b8-45d9-846d-e64165d09bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.204818 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5ce44-b6b8-45d9-846d-e64165d09bd9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-b9f5ce44-b6b8-45d9-846d-e64165d09bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:18.222493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:18.223456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:18.224591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:18.224591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:18.224591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:18.224591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:18.224591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 552/1084] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:18.225333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c799-8823-4de0-aa33-37b5a2c03c1a None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.225333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c799-8823-4de0-aa33-37b5a2c03c1a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.225596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c799-8823-4de0-aa33-37b5a2c03c1a None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.227031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 553/1085] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:18.229942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9c799-8823-4de0-aa33-37b5a2c03c1a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.253814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 533/1086] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:50:18.253814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d53b9-73d9-4934-967b-4aebd4e56d1b None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.253814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d53b9-73d9-4934-967b-4aebd4e56d1b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.253814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d53b9-73d9-4934-967b-4aebd4e56d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.267316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-007d53b9-73d9-4934-967b-4aebd4e56d1b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:18.268497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-007d53b9-73d9-4934-967b-4aebd4e56d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:18.271195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.330400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9c799-8823-4de0-aa33-37b5a2c03c1a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.333674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 534/1087] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:18.334499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d53b9-73d9-4934-967b-4aebd4e56d1b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.371720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.372382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.372665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.372945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.373688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:18.373991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.375392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.386466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 554/1088] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:18.387289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.390593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.457639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d53b9-73d9-4934-967b-4aebd4e56d1b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.497352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.498166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.498455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.498734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.499115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaee6f-d86e-44a8-856c-705edd1fd5c9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.508449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.511240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.512994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:18.537274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:18.538252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:18.539169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:50:18.539169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:18.539169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:50:18.539169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:18.539169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 535/1089] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:18.543812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.544614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.544984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.545267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.545965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.557329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:18.565844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:18.566978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:18.567959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 555/1090] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:18.574684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.678201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.687675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452e06f-f749-4b7c-b9c9-973b7d4d5c07 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.715990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1888099-af58-44c3-91b4-50b4e1799f54 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.721928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.722603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.722924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.723218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.723938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:18.724246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.725628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.737377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 536/1091] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:18.742877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.751434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.752103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.752392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.752674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.753416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:18.753728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.755107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.763198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 556/1092] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:18.768834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.795431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.844109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4617b-51e7-4031-9bdd-b5bf36b404ae None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.874920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1942386-b1e6-4d1c-9484-5390e044e187 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:18.879859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.880647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.880940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.881207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.887813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.889429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:50:18.907407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:18.908713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:18.909638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 537/1093] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:50:18.910124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:18.914383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:18.920367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:18.922160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:18.922160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:18.922160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] PATH_INFO: `/v3/users/64704e37984f478a9951e90491fb8d72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:18.923038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] RBAC: Authorizing `identity:get_user(user_id=64704e37984f478a9951e90491fb8d72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:18.924465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:18.926089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 557/1094] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/users/64704e37984f478a9951e90491fb8d72 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:18.931574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:19.016451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f57df5-5a3a-43e7-b829-e307e74eb77d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:19.029839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:19.031545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f675e-9f0d-4fd6-9296-1894f186b245 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:19.050501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:19.051177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:19.051461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:19.051743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:19.052522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:19.052828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:19.054334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:19.065638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:19.066179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 538/1095] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:19.066494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:19.066786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:19.067089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:19.068264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] RBAC: Authorizing `identity:get_project(project_id=88667c70bfcb44c7978e1c6d6993b252)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:19.069691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:19.071925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 558/1096] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:18 2022] GET /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:19.072161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:19.077349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:19.137275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:19.175880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d73fd5-abf8-4179-a0d0-2db6e8ff8c48 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:19.177512 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6dac9-1399-4b85-ab24-a7bbbe4aedcd None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:19.210465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e18ad-b308-43dc-a4c6-c6425049eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:19.211156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e18ad-b308-43dc-a4c6-c6425049eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:19.211442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e18ad-b308-43dc-a4c6-c6425049eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:19.211721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e18ad-b308-43dc-a4c6-c6425049eaa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:19.212702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7667c8-b243-4abc-bb24-0e0ef12b85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:19.213081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e18ad-b308-43dc-a4c6-c6425049eaa9 None admin] RBAC: Adding query filter params (role.id=54a508762524467f8c1da2c9cb827b85, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=4c0cbf8022ee4c37a591ee578b53806c) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:19.213395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e18ad-b308-43dc-a4c6-c6425049eaa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:19.213588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7667c8-b243-4abc-bb24-0e0ef12b85cf None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:19.213876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7667c8-b243-4abc-bb24-0e0ef12b85cf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:19.214159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7667c8-b243-4abc-bb24-0e0ef12b85cf None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252/users/64704e37984f478a9951e90491fb8d72/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:19.214845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e18ad-b308-43dc-a4c6-c6425049eaa9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:19.216164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7667c8-b243-4abc-bb24-0e0ef12b85cf None admin] RBAC: Authorizing `identity:create_grant(project_id=88667c70bfcb44c7978e1c6d6993b252, user_id=64704e37984f478a9951e90491fb8d72, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:19.217594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7667c8-b243-4abc-bb24-0e0ef12b85cf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:19.220649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 539/1097] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:19 2022] GET /identity/v3/role_assignments?user.id=4c0cbf8022ee4c37a591ee578b53806c&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=54a508762524467f8c1da2c9cb827b85 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:50:19.313232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 559/1098] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:50:19 2022] PUT /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252/users/64704e37984f478a9951e90491fb8d72/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:50:21.332297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a466def-823e-4c73-a5eb-aec4989c30dc None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:21.332827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a466def-823e-4c73-a5eb-aec4989c30dc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:21.332920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a466def-823e-4c73-a5eb-aec4989c30dc None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:21.334224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 540/1099] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:21.339763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d880a7-55a7-48b0-a45c-83b0380a2912 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:21.340176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d880a7-55a7-48b0-a45c-83b0380a2912 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:21.340399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d880a7-55a7-48b0-a45c-83b0380a2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:21.356853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a4d880a7-55a7-48b0-a45c-83b0380a2912 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:21.358080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a4d880a7-55a7-48b0-a45c-83b0380a2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:21.422290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 560/1100] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:21.446985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a466def-823e-4c73-a5eb-aec4989c30dc None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:21.482028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:21.545142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a466def-823e-4c73-a5eb-aec4989c30dc None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:21.577681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:21.578449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:21.578737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:21.579045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:21.594694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:21.596529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:21.597593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:21.598650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 541/1101] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:21.604176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d880a7-55a7-48b0-a45c-83b0380a2912 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:21.655311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:21.700941 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d880a7-55a7-48b0-a45c-83b0380a2912 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:21.733682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:21.734336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:21.734888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:21.735171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:21.735919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:21.736216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:21.737612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:21.746200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 561/1102] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:21.751975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:21.843904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:21.849618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bc751-8981-4fb4-a3b5-3540423c89c7 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:21.883265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:21.884146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:21.884435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:21.884712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] PATH_INFO: `/v3/users/64704e37984f478a9951e90491fb8d72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:21.885899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] RBAC: Authorizing `identity:get_user(user_id=64704e37984f478a9951e90491fb8d72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:21.887354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:21.888976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 542/1103] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:21 2022] GET /identity/v3/users/64704e37984f478a9951e90491fb8d72 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:21.894681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:21.990983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63282304-6ade-4a0e-8dbd-2ad24edee70b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:22.003760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:22.022383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:22.023050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:22.029634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:22.029634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:22.088814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:22.090273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:22.183626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 562/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:22.189387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:22.285618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653b70-1b2e-4ba8-b59a-6118e37d3309 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:22.317355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80933f5-2e71-4865-be83-0067ee57a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:22.318186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80933f5-2e71-4865-be83-0067ee57a020 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:22.318462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80933f5-2e71-4865-be83-0067ee57a020 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:22.318733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80933f5-2e71-4865-be83-0067ee57a020 None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:22.319939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80933f5-2e71-4865-be83-0067ee57a020 None admin] RBAC: Authorizing `identity:get_project(project_id=88667c70bfcb44c7978e1c6d6993b252)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:22.321878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80933f5-2e71-4865-be83-0067ee57a020 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:22.323557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 543/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:22 2022] GET /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:22.329454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:22.344427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:22.426957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21813b-340b-4c7b-8272-d5ba818828cf None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:22.459974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb40cc-1bba-4b68-8a0f-308d179fe0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:22.460560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb40cc-1bba-4b68-8a0f-308d179fe0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:22.460848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb40cc-1bba-4b68-8a0f-308d179fe0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:22.461129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb40cc-1bba-4b68-8a0f-308d179fe0a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:22.462569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb40cc-1bba-4b68-8a0f-308d179fe0a1 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=88667c70bfcb44c7978e1c6d6993b252, user.id=64704e37984f478a9951e90491fb8d72) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:22.462912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb40cc-1bba-4b68-8a0f-308d179fe0a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:22.464335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb40cc-1bba-4b68-8a0f-308d179fe0a1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:22.470067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 563/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:22 2022] GET /identity/v3/role_assignments?user.id=64704e37984f478a9951e90491fb8d72&scope.project.id=88667c70bfcb44c7978e1c6d6993b252&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:24.505708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d328d91-3598-4959-8984-03dbdcb639cf None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:24.506265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d328d91-3598-4959-8984-03dbdcb639cf None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:24.506265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d328d91-3598-4959-8984-03dbdcb639cf None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:24.507640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 544/1107] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:24.512764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411af60-24bf-4638-b065-4fe68b830004 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:24.513211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411af60-24bf-4638-b065-4fe68b830004 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:24.513326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411af60-24bf-4638-b065-4fe68b830004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:24.529892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9411af60-24bf-4638-b065-4fe68b830004 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:24.531095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9411af60-24bf-4638-b065-4fe68b830004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:24.598717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 564/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:24.623508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d328d91-3598-4959-8984-03dbdcb639cf None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:24.654582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:24.722424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d328d91-3598-4959-8984-03dbdcb639cf None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:24.754459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488195b1-13aa-4a61-9688-464152f4469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:24.755253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488195b1-13aa-4a61-9688-464152f4469b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:24.755539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488195b1-13aa-4a61-9688-464152f4469b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:24.755815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488195b1-13aa-4a61-9688-464152f4469b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:24.756966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488195b1-13aa-4a61-9688-464152f4469b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:24.758386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488195b1-13aa-4a61-9688-464152f4469b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:24.760499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 545/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:24.766151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411af60-24bf-4638-b065-4fe68b830004 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:24.776574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:24.862392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411af60-24bf-4638-b065-4fe68b830004 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:24.895166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677c4dc-3640-4fd6-ac64-f8aa6d594629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:24.895769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677c4dc-3640-4fd6-ac64-f8aa6d594629 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:24.896053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677c4dc-3640-4fd6-ac64-f8aa6d594629 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:24.896329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677c4dc-3640-4fd6-ac64-f8aa6d594629 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:24.897034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677c4dc-3640-4fd6-ac64-f8aa6d594629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:24.898450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677c4dc-3640-4fd6-ac64-f8aa6d594629 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:25.023197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 565/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:50:24 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:27.128445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187118-1155-497c-adb9-f5a510aa5c1b None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:27.129011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187118-1155-497c-adb9-f5a510aa5c1b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:27.129011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187118-1155-497c-adb9-f5a510aa5c1b None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:27.130345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 546/1111] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:27.136027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858a723-d385-4234-8143-22174339e5cf None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:27.136466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858a723-d385-4234-8143-22174339e5cf None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:27.136574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858a723-d385-4234-8143-22174339e5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:27.153465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9858a723-d385-4234-8143-22174339e5cf None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:27.154670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9858a723-d385-4234-8143-22174339e5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:27.211001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:27.219075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 566/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:27.243664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50187118-1155-497c-adb9-f5a510aa5c1b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:27.345097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:27.348824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50187118-1155-497c-adb9-f5a510aa5c1b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:27.382414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:27.383232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:27.384106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:27.384385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] PATH_INFO: `/v3/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:27.385853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] RBAC: Authorizing `identity:get_role(role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:27.387248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:27.388592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 547/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:27 2022] GET /identity/v3/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:27.394289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858a723-d385-4234-8143-22174339e5cf None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:27.489465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858a723-d385-4234-8143-22174339e5cf None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:27.521106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:27.521954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:27.522238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:27.522517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] PATH_INFO: `/v3/users/d60b9d61f10240e6ac40fc5c2e56e059` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:27.535460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] RBAC: Authorizing `identity:get_user(user_id=d60b9d61f10240e6ac40fc5c2e56e059)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:27.536898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:27.538497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 567/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:27 2022] GET /identity/v3/users/d60b9d61f10240e6ac40fc5c2e56e059 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:27.544795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:27.640829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b573e-a051-4336-854e-050b98b09e12 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:27.673228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:27.673861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:27.674147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:27.674436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:27.708836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:27.740703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:27.742649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:27.849602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 548/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:27.855535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:27.907351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:27.953633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858971d-6520-41a4-9795-96e528cc494e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:27.985273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca4747-db9e-439f-a658-f8afdffe9e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:27.986113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca4747-db9e-439f-a658-f8afdffe9e63 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:27.986395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca4747-db9e-439f-a658-f8afdffe9e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:27.986671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca4747-db9e-439f-a658-f8afdffe9e63 None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:27.987853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca4747-db9e-439f-a658-f8afdffe9e63 None admin] RBAC: Authorizing `identity:get_project(project_id=88667c70bfcb44c7978e1c6d6993b252)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:27.989275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca4747-db9e-439f-a658-f8afdffe9e63 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:27.991093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 568/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:27 2022] GET /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:27.997588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:28.061070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:28.092901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb982-6eae-4905-b9d1-b7468432acc2 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:28.126414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e644e-fc04-4216-8bc6-f2908d78c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:28.127084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e644e-fc04-4216-8bc6-f2908d78c76d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:28.127371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e644e-fc04-4216-8bc6-f2908d78c76d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:28.127647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e644e-fc04-4216-8bc6-f2908d78c76d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:28.128467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e644e-fc04-4216-8bc6-f2908d78c76d None admin] RBAC: Adding query filter params (role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=88667c70bfcb44c7978e1c6d6993b252, user.id=d60b9d61f10240e6ac40fc5c2e56e059) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:28.128777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e644e-fc04-4216-8bc6-f2908d78c76d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:28.130184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e644e-fc04-4216-8bc6-f2908d78c76d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:28.136046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 549/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:27 2022] GET /identity/v3/role_assignments?user.id=d60b9d61f10240e6ac40fc5c2e56e059&scope.project.id=88667c70bfcb44c7978e1c6d6993b252&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:30.105923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bfef7-587a-4568-bbdf-7fc139074f9c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.106451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bfef7-587a-4568-bbdf-7fc139074f9c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.106569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bfef7-587a-4568-bbdf-7fc139074f9c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.107883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 569/1118] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:30.113224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3d829-8c3b-431c-901f-f2465879f106 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.113678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3d829-8c3b-431c-901f-f2465879f106 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.113773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3d829-8c3b-431c-901f-f2465879f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.130635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-71d3d829-8c3b-431c-901f-f2465879f106 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:30.131840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-71d3d829-8c3b-431c-901f-f2465879f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:30.195260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 550/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:30.218036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bfef7-587a-4568-bbdf-7fc139074f9c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:30.317142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bfef7-587a-4568-bbdf-7fc139074f9c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:30.336108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:30.349876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:30.353756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.353756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.353756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] PATH_INFO: `/v3/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.353756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] RBAC: Authorizing `identity:get_role(role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:30.354845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:30.356266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 570/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:30 2022] GET /identity/v3/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:30.362213 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3d829-8c3b-431c-901f-f2465879f106 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:30.423516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:30.461142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3d829-8c3b-431c-901f-f2465879f106 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:30.494304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:30.495182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.495469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.495744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] PATH_INFO: `/v3/users/d60b9d61f10240e6ac40fc5c2e56e059` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.496913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] RBAC: Authorizing `identity:get_user(user_id=d60b9d61f10240e6ac40fc5c2e56e059)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:30.498324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:30.499945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 551/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:30 2022] GET /identity/v3/users/d60b9d61f10240e6ac40fc5c2e56e059 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:30.505786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:30.601373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc4f3e-84ee-461b-a738-f8cbe9a2e85c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:30.634712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32593-83b0-4564-bd35-44c2ad81b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:30.635519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32593-83b0-4564-bd35-44c2ad81b197 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.635800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32593-83b0-4564-bd35-44c2ad81b197 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.636074 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32593-83b0-4564-bd35-44c2ad81b197 None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.637214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32593-83b0-4564-bd35-44c2ad81b197 None admin] RBAC: Authorizing `identity:get_project(project_id=88667c70bfcb44c7978e1c6d6993b252)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:30.638620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee32593-83b0-4564-bd35-44c2ad81b197 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:30.640295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 571/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:30 2022] GET /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:30.645950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:30.740447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2181c1d-00a6-4e3d-8fd9-34064881facc None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:30.767636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:30.773034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f0bc2-d959-4645-b8f9-d9e61f7c00e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:30.781041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0bc2-d959-4645-b8f9-d9e61f7c00e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:30.781041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0bc2-d959-4645-b8f9-d9e61f7c00e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:30.781041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0bc2-d959-4645-b8f9-d9e61f7c00e8 None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252/users/d60b9d61f10240e6ac40fc5c2e56e059/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:30.781041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f0bc2-d959-4645-b8f9-d9e61f7c00e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=88667c70bfcb44c7978e1c6d6993b252, user_id=d60b9d61f10240e6ac40fc5c2e56e059, role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:30.781041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f0bc2-d959-4645-b8f9-d9e61f7c00e8 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:30.857230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 552/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:50:30 2022] PUT /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252/users/d60b9d61f10240e6ac40fc5c2e56e059/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:32.845526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6eb9c-d619-426c-9951-a8243d5ada8c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.846051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6eb9c-d619-426c-9951-a8243d5ada8c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.846178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6eb9c-d619-426c-9951-a8243d5ada8c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.847549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 572/1124] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:32.852882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f16c-a193-43de-844a-42f40f7061ac None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:32.853280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f16c-a193-43de-844a-42f40f7061ac None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:32.853448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f16c-a193-43de-844a-42f40f7061ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:32.870293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-4302f16c-a193-43de-844a-42f40f7061ac None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:32.871513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4302f16c-a193-43de-844a-42f40f7061ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:32.935670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 553/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:32.959705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6eb9c-d619-426c-9951-a8243d5ada8c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:33.016030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:33.058509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6eb9c-d619-426c-9951-a8243d5ada8c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:33.090634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:33.091497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:33.091780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:33.092054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] PATH_INFO: `/v3/roles/707ca0f8bce4474b9bddf3c7c6f5d389` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:33.093513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] RBAC: Authorizing `identity:get_role(role_id=707ca0f8bce4474b9bddf3c7c6f5d389)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:33.094870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:33.096259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 573/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:32 2022] GET /identity/v3/roles/707ca0f8bce4474b9bddf3c7c6f5d389 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:33.101887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f16c-a193-43de-844a-42f40f7061ac None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:33.196219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f16c-a193-43de-844a-42f40f7061ac None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:33.215620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:33.228542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:33.234600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:33.234600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:33.234600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] PATH_INFO: `/v3/users/d60b9d61f10240e6ac40fc5c2e56e059` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:33.234600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] RBAC: Authorizing `identity:get_user(user_id=d60b9d61f10240e6ac40fc5c2e56e059)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:33.234600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:33.234600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 554/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:33 2022] GET /identity/v3/users/d60b9d61f10240e6ac40fc5c2e56e059 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:33.240068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:33.336911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4aabd-5fee-4d6d-b2bf-3d9d14a5ca1b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:33.359021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:33.370011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:33.370651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:33.371798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:33.371798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:33.435136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:33.436595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:33.529540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 574/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:33.535508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:33.630512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ff83c-186a-42f5-9000-d2bc89cf6e39 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:33.662001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc0355-4a9b-485d-92cf-2d2e94967056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:33.662844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc0355-4a9b-485d-92cf-2d2e94967056 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:33.663142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc0355-4a9b-485d-92cf-2d2e94967056 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:33.663414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc0355-4a9b-485d-92cf-2d2e94967056 None admin] PATH_INFO: `/v3/projects/88667c70bfcb44c7978e1c6d6993b252` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:33.665095 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc0355-4a9b-485d-92cf-2d2e94967056 None admin] RBAC: Authorizing `identity:get_project(project_id=88667c70bfcb44c7978e1c6d6993b252)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:33.666503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc0355-4a9b-485d-92cf-2d2e94967056 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:33.668177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 555/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:33 2022] GET /identity/v3/projects/88667c70bfcb44c7978e1c6d6993b252 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:33.674057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:33.697799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:33.768872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd7c83-0f96-48f3-84ae-3f03f5ff626e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:33.800996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c0699-4e3f-456c-a82c-1b0eafe11119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:33.801632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c0699-4e3f-456c-a82c-1b0eafe11119 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:33.801914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c0699-4e3f-456c-a82c-1b0eafe11119 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:33.802193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c0699-4e3f-456c-a82c-1b0eafe11119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:33.803034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c0699-4e3f-456c-a82c-1b0eafe11119 None admin] RBAC: Adding query filter params (role.id=707ca0f8bce4474b9bddf3c7c6f5d389, scope.project.id=88667c70bfcb44c7978e1c6d6993b252, user.id=d60b9d61f10240e6ac40fc5c2e56e059) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:33.803344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c0699-4e3f-456c-a82c-1b0eafe11119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:33.804747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c0699-4e3f-456c-a82c-1b0eafe11119 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:33.811070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 575/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:33 2022] GET /identity/v3/role_assignments?user.id=d60b9d61f10240e6ac40fc5c2e56e059&scope.project.id=88667c70bfcb44c7978e1c6d6993b252&role.id=707ca0f8bce4474b9bddf3c7c6f5d389 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:35.891102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b61a99-58d8-40c5-bca9-548ad3cd094a None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:35.891659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b61a99-58d8-40c5-bca9-548ad3cd094a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:35.891659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b61a99-58d8-40c5-bca9-548ad3cd094a None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:35.893066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 556/1131] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:35.898205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919933c-6f41-47e5-b144-462afd59dfe4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:35.898646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919933c-6f41-47e5-b144-462afd59dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:35.898800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919933c-6f41-47e5-b144-462afd59dfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:35.915436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d919933c-6f41-47e5-b144-462afd59dfe4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:35.916604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d919933c-6f41-47e5-b144-462afd59dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:35.979545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 576/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:36.003573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b61a99-58d8-40c5-bca9-548ad3cd094a None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:36.058816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:36.103140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b61a99-58d8-40c5-bca9-548ad3cd094a None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:36.136121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c25a3-75a3-46c8-a3f5-5417c9222254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:36.136896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c25a3-75a3-46c8-a3f5-5417c9222254 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:36.137175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c25a3-75a3-46c8-a3f5-5417c9222254 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:36.137449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c25a3-75a3-46c8-a3f5-5417c9222254 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:36.138601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c25a3-75a3-46c8-a3f5-5417c9222254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:36.140048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c25a3-75a3-46c8-a3f5-5417c9222254 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:36.141681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 557/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:36.147321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919933c-6f41-47e5-b144-462afd59dfe4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:36.165790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:36.242281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919933c-6f41-47e5-b144-462afd59dfe4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:36.274183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b15a1-f265-4b8c-b51d-d0493fd792d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:36.274803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b15a1-f265-4b8c-b51d-d0493fd792d0 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:36.275112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b15a1-f265-4b8c-b51d-d0493fd792d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:36.275384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b15a1-f265-4b8c-b51d-d0493fd792d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:36.276082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b15a1-f265-4b8c-b51d-d0493fd792d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:36.277478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b15a1-f265-4b8c-b51d-d0493fd792d0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:36.376167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 577/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:50:36 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:38.415725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7e0be-99c9-4d4b-9623-a5536a5fa020 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:38.416219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7e0be-99c9-4d4b-9623-a5536a5fa020 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:38.416314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7e0be-99c9-4d4b-9623-a5536a5fa020 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:38.417655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 558/1135] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:38.422774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9fcc-4b79-4dc8-9e3f-3c079021e8db None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:38.423193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9fcc-4b79-4dc8-9e3f-3c079021e8db None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:38.423384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9fcc-4b79-4dc8-9e3f-3c079021e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:38.439645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-491e9fcc-4b79-4dc8-9e3f-3c079021e8db None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:38.440821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-491e9fcc-4b79-4dc8-9e3f-3c079021e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:38.501347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:38.505727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 578/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:38.530762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7e0be-99c9-4d4b-9623-a5536a5fa020 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:38.628838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7e0be-99c9-4d4b-9623-a5536a5fa020 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:38.651764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:38.661774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d951e4b-ce40-41c2-be3d-6df811a81302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:38.662597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d951e4b-ce40-41c2-be3d-6df811a81302 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:38.662902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d951e4b-ce40-41c2-be3d-6df811a81302 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:38.663183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d951e4b-ce40-41c2-be3d-6df811a81302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:38.664992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d951e4b-ce40-41c2-be3d-6df811a81302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:38.666409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d951e4b-ce40-41c2-be3d-6df811a81302 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:38.668026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 559/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:50:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:38.673651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e9fcc-4b79-4dc8-9e3f-3c079021e8db None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:38.768749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e9fcc-4b79-4dc8-9e3f-3c079021e8db None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:38.801597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b429d0-627e-499d-a639-3c74eb36fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:38.802253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b429d0-627e-499d-a639-3c74eb36fc86 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:38.802538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b429d0-627e-499d-a639-3c74eb36fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:38.802817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b429d0-627e-499d-a639-3c74eb36fc86 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:38.803550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b429d0-627e-499d-a639-3c74eb36fc86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:38.805000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b429d0-627e-499d-a639-3c74eb36fc86 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:38.873892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 579/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:50:38 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:40.948657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cb25-2104-4765-a727-61bc1511b05c None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:40.949183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cb25-2104-4765-a727-61bc1511b05c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:40.949183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cb25-2104-4765-a727-61bc1511b05c None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:40.950565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 560/1139] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:40.955707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9301-fe76-4fb4-9db8-47d51320a4ab None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:40.956133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9301-fe76-4fb4-9db8-47d51320a4ab None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:40.956262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9301-fe76-4fb4-9db8-47d51320a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:40.972440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6bbe9301-fe76-4fb4-9db8-47d51320a4ab None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:40.973611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6bbe9301-fe76-4fb4-9db8-47d51320a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:41.022897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:41.038389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 580/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:41.062409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cb25-2104-4765-a727-61bc1511b05c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:41.159884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cb25-2104-4765-a727-61bc1511b05c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:41.201261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:41.201969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:41.202255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:41.202530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:41.212295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:41.219800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:41.220955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:41.221873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 561/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:41.227407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9301-fe76-4fb4-9db8-47d51320a4ab None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:41.322335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9301-fe76-4fb4-9db8-47d51320a4ab None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:41.355077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:41.355738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:41.356022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:41.356299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:41.357040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:41.357345 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:41.358711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:41.367620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 581/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:50:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:41.373117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:41.427105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:41.472323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9ad1-3790-4821-9bc4-7a1d00ac70ca None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:41.504387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:41.505232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:41.505513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:41.505791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] PATH_INFO: `/v3/users/220ca60bc40d4f6d9b98dfe5a8c560fa` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:41.518232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] RBAC: Authorizing `identity:get_user(user_id=220ca60bc40d4f6d9b98dfe5a8c560fa)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:41.519736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:41.521336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 562/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:41 2022] GET /identity/v3/users/220ca60bc40d4f6d9b98dfe5a8c560fa => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:41.527623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:41.574614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:41.662259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f16ff-85fe-4567-9708-13e0a0511af5 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:41.694753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:41.695436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:41.695721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:41.696005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:41.761168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:41.762552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:41.808062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:41.857487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 582/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:41.863555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:41.959668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be11c8-065e-454e-8654-54a7586d3e9b None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:41.970401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:41.992481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb5b21-1f88-4b91-a3e8-bf5c41c3ef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:41.993317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb5b21-1f88-4b91-a3e8-bf5c41c3ef54 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:41.993600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb5b21-1f88-4b91-a3e8-bf5c41c3ef54 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:41.993877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb5b21-1f88-4b91-a3e8-bf5c41c3ef54 None admin] PATH_INFO: `/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:41.995062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb5b21-1f88-4b91-a3e8-bf5c41c3ef54 None admin] RBAC: Authorizing `identity:get_project(project_id=c2958b4138b3404bb7e3e5ca74c3fbeb)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:41.996477 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb5b21-1f88-4b91-a3e8-bf5c41c3ef54 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:41.998121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 563/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:41 2022] GET /identity/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:42.004202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:42.101477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f848-f72e-4b26-b691-10e4a5bb9e70 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:42.134519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1f2d3-7573-4f2e-a6f3-e190e2cda2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:42.135190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1f2d3-7573-4f2e-a6f3-e190e2cda2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:42.135480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1f2d3-7573-4f2e-a6f3-e190e2cda2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:42.135760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1f2d3-7573-4f2e-a6f3-e190e2cda2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:42.136582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1f2d3-7573-4f2e-a6f3-e190e2cda2c8 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=c2958b4138b3404bb7e3e5ca74c3fbeb, user.id=220ca60bc40d4f6d9b98dfe5a8c560fa) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:42.136897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1f2d3-7573-4f2e-a6f3-e190e2cda2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:42.138315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1f2d3-7573-4f2e-a6f3-e190e2cda2c8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:42.143611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 583/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:42 2022] GET /identity/v3/role_assignments?user.id=220ca60bc40d4f6d9b98dfe5a8c560fa&scope.project.id=c2958b4138b3404bb7e3e5ca74c3fbeb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:44.133340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9509c75-4c91-4257-a8f6-d2f18b761295 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:44.133939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9509c75-4c91-4257-a8f6-d2f18b761295 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:44.133939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9509c75-4c91-4257-a8f6-d2f18b761295 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:44.135304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 564/1147] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:44.140423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e73b78-d0ef-4868-9ff6-42ec6f31e479 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:44.140839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e73b78-d0ef-4868-9ff6-42ec6f31e479 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:44.140992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e73b78-d0ef-4868-9ff6-42ec6f31e479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:44.157102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-38e73b78-d0ef-4868-9ff6-42ec6f31e479 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:44.158259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-38e73b78-d0ef-4868-9ff6-42ec6f31e479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:44.165843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:44.223654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 584/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:44.247201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9509c75-4c91-4257-a8f6-d2f18b761295 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:44.344051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9509c75-4c91-4257-a8f6-d2f18b761295 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:44.377896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:44.378668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:44.378980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:44.379254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:44.389257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:44.396724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:44.397654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:44.399059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 565/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:44.404427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e73b78-d0ef-4868-9ff6-42ec6f31e479 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:44.498643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e73b78-d0ef-4868-9ff6-42ec6f31e479 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:44.531413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:44.532067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:44.532350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:44.532625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:44.533360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:44.533662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:44.535036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:44.543336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 585/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:44.549074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:44.587500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:44.645283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf4d4-2d45-4511-921b-06c807692640 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:44.678399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:44.679287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:44.679571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:44.679846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] PATH_INFO: `/v3/users/220ca60bc40d4f6d9b98dfe5a8c560fa` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:44.681007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] RBAC: Authorizing `identity:get_user(user_id=220ca60bc40d4f6d9b98dfe5a8c560fa)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:44.682421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:44.684117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 566/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:44 2022] GET /identity/v3/users/220ca60bc40d4f6d9b98dfe5a8c560fa => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:44.689711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:44.693401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:44.785522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ee65-9b85-4a85-8c13-02ddab3fbb6b None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:44.817221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad65c00-4941-4a12-86fc-f9b875abdc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:44.818057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65c00-4941-4a12-86fc-f9b875abdc0b None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:44.818337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65c00-4941-4a12-86fc-f9b875abdc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:44.818608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65c00-4941-4a12-86fc-f9b875abdc0b None admin] PATH_INFO: `/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:44.819768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad65c00-4941-4a12-86fc-f9b875abdc0b None admin] RBAC: Authorizing `identity:get_project(project_id=c2958b4138b3404bb7e3e5ca74c3fbeb)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:44.821696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad65c00-4941-4a12-86fc-f9b875abdc0b None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:44.823370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 586/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:44 2022] GET /identity/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:44.829098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:44.924591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4527-cfd4-42d8-b3b8-724ce50232a1 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:44.931597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:44.957371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0558-3761-47dc-95eb-2542afda5448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:44.958237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0558-3761-47dc-95eb-2542afda5448 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:44.958561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0558-3761-47dc-95eb-2542afda5448 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:44.959062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0558-3761-47dc-95eb-2542afda5448 None admin] PATH_INFO: `/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb/users/220ca60bc40d4f6d9b98dfe5a8c560fa/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:44.962030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0558-3761-47dc-95eb-2542afda5448 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2958b4138b3404bb7e3e5ca74c3fbeb, user_id=220ca60bc40d4f6d9b98dfe5a8c560fa, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:44.963483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0558-3761-47dc-95eb-2542afda5448 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:45.045237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 567/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:50:44 2022] PUT /identity/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb/users/220ca60bc40d4f6d9b98dfe5a8c560fa/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:50:47.038009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc97d-bd67-46df-ab9b-b984108899aa None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.038591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc97d-bd67-46df-ab9b-b984108899aa None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.039208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc97d-bd67-46df-ab9b-b984108899aa None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.040506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 587/1154] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:47.045770 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0dd8-5f0e-4086-95a7-4b53a9309077 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.046153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0dd8-5f0e-4086-95a7-4b53a9309077 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.046333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0dd8-5f0e-4086-95a7-4b53a9309077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.062554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-50eb0dd8-5f0e-4086-95a7-4b53a9309077 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:47.063771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-50eb0dd8-5f0e-4086-95a7-4b53a9309077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:47.129619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 568/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:47.154116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edc97d-bd67-46df-ab9b-b984108899aa None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:47.229312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:47.258702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edc97d-bd67-46df-ab9b-b984108899aa None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:47.291279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:47.291994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.292281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.292559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.302185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:50:47.309712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:47.311014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:50:47.312037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 588/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:47.316910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb0dd8-5f0e-4086-95a7-4b53a9309077 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:47.409121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:47.414805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb0dd8-5f0e-4086-95a7-4b53a9309077 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:47.449972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:47.450632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.450947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.451227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.451968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:47.452273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:47.453675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:47.461426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 569/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:47.467253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:47.563243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3f11e-fb8a-440f-b8e3-916901108bca None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:47.590877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:47.595476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:47.596399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.596685 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.596963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] PATH_INFO: `/v3/users/220ca60bc40d4f6d9b98dfe5a8c560fa` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.598143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] RBAC: Authorizing `identity:get_user(user_id=220ca60bc40d4f6d9b98dfe5a8c560fa)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:47.599588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:47.601197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 589/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:50:47 2022] GET /identity/v3/users/220ca60bc40d4f6d9b98dfe5a8c560fa => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:47.606841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:47.703221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad586853-fc85-41a5-bb1a-4948c3dc54ef None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:47.735298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:47.735926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:47.736209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:47.736484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:47.763030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:47.802132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:47.803588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:47.898397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 570/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:47.904186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:48.000468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73cbfc-1b8f-492c-a476-3fdd20b0c32d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:48.031605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1512-d058-4238-a482-4647b0245da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:48.032434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1512-d058-4238-a482-4647b0245da1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:48.032713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1512-d058-4238-a482-4647b0245da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:48.032985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1512-d058-4238-a482-4647b0245da1 None admin] PATH_INFO: `/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:48.034118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1512-d058-4238-a482-4647b0245da1 None admin] RBAC: Authorizing `identity:get_project(project_id=c2958b4138b3404bb7e3e5ca74c3fbeb)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:48.035592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1512-d058-4238-a482-4647b0245da1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:48.037294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 590/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:50:47 2022] GET /identity/v3/projects/c2958b4138b3404bb7e3e5ca74c3fbeb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:48.043956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:48.098542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:48.138001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacafc14-3e6d-4557-a32e-64517618365a None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:48.170651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9764dd-440b-47b1-81e0-7570bfc66366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:48.171318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9764dd-440b-47b1-81e0-7570bfc66366 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:48.171600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9764dd-440b-47b1-81e0-7570bfc66366 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:48.171873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9764dd-440b-47b1-81e0-7570bfc66366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:48.172696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9764dd-440b-47b1-81e0-7570bfc66366 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=c2958b4138b3404bb7e3e5ca74c3fbeb, user.id=220ca60bc40d4f6d9b98dfe5a8c560fa) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:48.173006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9764dd-440b-47b1-81e0-7570bfc66366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:48.174411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9764dd-440b-47b1-81e0-7570bfc66366 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:48.180179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 571/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:50:48 2022] GET /identity/v3/role_assignments?user.id=220ca60bc40d4f6d9b98dfe5a8c560fa&scope.project.id=c2958b4138b3404bb7e3e5ca74c3fbeb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:50.193000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588f900-882d-48c7-ab42-0d3ef7d2bf4c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:50.193532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588f900-882d-48c7-ab42-0d3ef7d2bf4c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:50.193532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588f900-882d-48c7-ab42-0d3ef7d2bf4c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:50.195485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 591/1162] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:50.200499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91003f-818c-476a-8db1-acff731ea99d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:50.200868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91003f-818c-476a-8db1-acff731ea99d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:50.201064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91003f-818c-476a-8db1-acff731ea99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:50.218076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-0b91003f-818c-476a-8db1-acff731ea99d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:50.219297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0b91003f-818c-476a-8db1-acff731ea99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:50.283144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 572/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:50.304558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588f900-882d-48c7-ab42-0d3ef7d2bf4c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:50.370115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:50.404155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588f900-882d-48c7-ab42-0d3ef7d2bf4c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:50.436573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:50.437204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:50.437484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:50.437757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:50.506381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:50.508330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:50.568211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:50.601210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 592/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:50:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:50:50.606986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91003f-818c-476a-8db1-acff731ea99d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:50.657835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:50.702621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91003f-818c-476a-8db1-acff731ea99d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:50.734382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc045f-a85c-4e25-87ee-3ecdf0bef801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:50.735251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc045f-a85c-4e25-87ee-3ecdf0bef801 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:50.735535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc045f-a85c-4e25-87ee-3ecdf0bef801 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:50.735809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc045f-a85c-4e25-87ee-3ecdf0bef801 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:50.742739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc045f-a85c-4e25-87ee-3ecdf0bef801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:50.744175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc045f-a85c-4e25-87ee-3ecdf0bef801 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-44cc045f-a85c-4e25-87ee-3ecdf0bef801 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:50:50.758426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:50:50.759738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:50:50.760903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 573/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:50:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:50:50.765303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:50.859374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9248-2e25-4287-bf7e-75745e4b774f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:50.891514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9bdac-3a46-44a7-b2d8-5e657672c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:50.892157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bdac-3a46-44a7-b2d8-5e657672c7ce None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:50.892442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bdac-3a46-44a7-b2d8-5e657672c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:50.892721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bdac-3a46-44a7-b2d8-5e657672c7ce None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:50.893434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9bdac-3a46-44a7-b2d8-5e657672c7ce None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:50:50.893740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9bdac-3a46-44a7-b2d8-5e657672c7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:50.895112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9bdac-3a46-44a7-b2d8-5e657672c7ce None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:50.901974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 593/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 22 08:50:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:52.902985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560945e7-1651-426f-9611-cf1f43a496ea None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:52.903544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560945e7-1651-426f-9611-cf1f43a496ea None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:52.903544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560945e7-1651-426f-9611-cf1f43a496ea None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:52.904895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 574/1167] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:52.910072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca72cf-5055-4e3d-9de1-925ed3434288 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:52.910505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca72cf-5055-4e3d-9de1-925ed3434288 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:52.910660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca72cf-5055-4e3d-9de1-925ed3434288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:52.927630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b0ca72cf-5055-4e3d-9de1-925ed3434288 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:52.928825 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b0ca72cf-5055-4e3d-9de1-925ed3434288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:52.953617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:52.994636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 594/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:53.017612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560945e7-1651-426f-9611-cf1f43a496ea None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:53.117738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560945e7-1651-426f-9611-cf1f43a496ea None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:53.130238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:53.151015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1729d8-520a-42e1-9a10-8d867a7a7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:53.151657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1729d8-520a-42e1-9a10-8d867a7a7b0c None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:53.151939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1729d8-520a-42e1-9a10-8d867a7a7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:53.152214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1729d8-520a-42e1-9a10-8d867a7a7b0c None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:53.152952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1729d8-520a-42e1-9a10-8d867a7a7b0c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:53.154351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1729d8-520a-42e1-9a10-8d867a7a7b0c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:53.249715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 575/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Wed Jun 22 08:50:53 2022] POST /identity/v3/domains => generated 267 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:55.313075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573509d-8320-470a-886d-b7878bdfa944 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:55.313689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573509d-8320-470a-886d-b7878bdfa944 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:55.313689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573509d-8320-470a-886d-b7878bdfa944 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:55.315037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 595/1170] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:55.320826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e93e42-6f0d-4a8e-b0bf-6a3e0fb84fcd None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:55.321235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e93e42-6f0d-4a8e-b0bf-6a3e0fb84fcd None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:55.321384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e93e42-6f0d-4a8e-b0bf-6a3e0fb84fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:55.338315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-05e93e42-6f0d-4a8e-b0bf-6a3e0fb84fcd None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:55.339540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-05e93e42-6f0d-4a8e-b0bf-6a3e0fb84fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:55.404934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 576/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:50:55.428533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573509d-8320-470a-886d-b7878bdfa944 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:55.526846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573509d-8320-470a-886d-b7878bdfa944 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:55.558964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a03d5-97a7-42e1-aa85-47735b043aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:55.559804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a03d5-97a7-42e1-aa85-47735b043aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:55.560090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a03d5-97a7-42e1-aa85-47735b043aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:55.560364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a03d5-97a7-42e1-aa85-47735b043aa2 None admin] PATH_INFO: `/v3/domains/ae1b7445ffc0443489e2e312b457dacc` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:55.570998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a03d5-97a7-42e1-aa85-47735b043aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae1b7445ffc0443489e2e312b457dacc)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:55.572382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a03d5-97a7-42e1-aa85-47735b043aa2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:55.573994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 596/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Jun 22 08:50:55 2022] GET /identity/v3/domains/ae1b7445ffc0443489e2e312b457dacc => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:55.579826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e93e42-6f0d-4a8e-b0bf-6a3e0fb84fcd None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:55.674530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e93e42-6f0d-4a8e-b0bf-6a3e0fb84fcd None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:55.676034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:55.707821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6c0e-309f-4adc-9682-bbb084a5c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:55.708474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6c0e-309f-4adc-9682-bbb084a5c178 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:55.708759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6c0e-309f-4adc-9682-bbb084a5c178 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:55.709035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6c0e-309f-4adc-9682-bbb084a5c178 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:55.709736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6c0e-309f-4adc-9682-bbb084a5c178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:55.711212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6c0e-309f-4adc-9682-bbb084a5c178 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:55.788883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 577/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:50:55 2022] POST /identity/v3/projects => generated 361 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:50:57.895367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cfa6-1c3b-463b-abdd-791ee0a73092 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:57.895894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cfa6-1c3b-463b-abdd-791ee0a73092 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:57.896007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cfa6-1c3b-463b-abdd-791ee0a73092 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:57.897970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 597/1174] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:50:57.903248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f0a39-1f95-4b1e-86c7-f75c520ce7ab None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:57.903817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f0a39-1f95-4b1e-86c7-f75c520ce7ab None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:57.903817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f0a39-1f95-4b1e-86c7-f75c520ce7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:57.920143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-315f0a39-1f95-4b1e-86c7-f75c520ce7ab None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:50:57.921328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-315f0a39-1f95-4b1e-86c7-f75c520ce7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:50:57.985798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 578/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:50:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:50:58.011422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292cfa6-1c3b-463b-abdd-791ee0a73092 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:58.035390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:58.109702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292cfa6-1c3b-463b-abdd-791ee0a73092 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:58.142557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f2839-1aa9-4370-b2bc-a8dc1225d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:58.143429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f2839-1aa9-4370-b2bc-a8dc1225d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:58.143718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f2839-1aa9-4370-b2bc-a8dc1225d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:58.143996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f2839-1aa9-4370-b2bc-a8dc1225d7d3 None admin] PATH_INFO: `/v3/domains/ae1b7445ffc0443489e2e312b457dacc` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:58.145154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f2839-1aa9-4370-b2bc-a8dc1225d7d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae1b7445ffc0443489e2e312b457dacc)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:58.146619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f2839-1aa9-4370-b2bc-a8dc1225d7d3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:58.148206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 598/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Jun 22 08:50:58 2022] GET /identity/v3/domains/ae1b7445ffc0443489e2e312b457dacc => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:50:58.153811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f0a39-1f95-4b1e-86c7-f75c520ce7ab None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:50:58.235762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:50:58.251023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f0a39-1f95-4b1e-86c7-f75c520ce7ab None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:50:58.283398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101201cc-8029-4657-b2e5-14eee2f9d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:50:58.284053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101201cc-8029-4657-b2e5-14eee2f9d5c1 None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:50:58.284342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101201cc-8029-4657-b2e5-14eee2f9d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:50:58.284620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101201cc-8029-4657-b2e5-14eee2f9d5c1 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:50:58.285327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101201cc-8029-4657-b2e5-14eee2f9d5c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:50:58.286738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101201cc-8029-4657-b2e5-14eee2f9d5c1 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:50:58.373991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 579/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:50:58 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:51:00.429866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e9b5a-fa9b-477d-88ad-d83c933f585e None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:00.430377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e9b5a-fa9b-477d-88ad-d83c933f585e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:00.430488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e9b5a-fa9b-477d-88ad-d83c933f585e None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:00.431822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 599/1178] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:51:00.437040 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47e3ed-d817-4d95-843a-dac2d25647d7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:00.437415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47e3ed-d817-4d95-843a-dac2d25647d7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:00.437639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47e3ed-d817-4d95-843a-dac2d25647d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:00.454646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fe47e3ed-d817-4d95-843a-dac2d25647d7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:00.455871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fe47e3ed-d817-4d95-843a-dac2d25647d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:00.520619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 580/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:51:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:51:00.544505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e9b5a-fa9b-477d-88ad-d83c933f585e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:00.632936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:00.642974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e9b5a-fa9b-477d-88ad-d83c933f585e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:00.676248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:00.677018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:00.677300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:00.677581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:00.687896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:51:00.695292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:51:00.696446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:51:00.697401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 600/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:51:00.702332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47e3ed-d817-4d95-843a-dac2d25647d7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:00.769223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:00.798227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47e3ed-d817-4d95-843a-dac2d25647d7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:00.831831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:00.832480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:00.832765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:00.833042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:00.833787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:51:00.834093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:00.836113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:00.843830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 581/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:00.849405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:00.946463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9b929-52fe-4a0c-a373-db959a48f693 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:00.977716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:00.978561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:00.978860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:00.979140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] PATH_INFO: `/v3/users/c5f491f5f1d24f4397cb25577d456c5e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:00.992215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] RBAC: Authorizing `identity:get_user(user_id=c5f491f5f1d24f4397cb25577d456c5e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:00.993627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:00.995253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 601/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:51:00 2022] GET /identity/v3/users/c5f491f5f1d24f4397cb25577d456c5e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:01.000693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:01.096067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c479db-e549-4aa9-9e5b-74fa4d7d17c6 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:01.123963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:01.128634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:01.129271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:01.129553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:01.129832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:01.195486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:01.197036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:01.290071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 582/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:51:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:01.299972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:01.311150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:01.397619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37165914-cd32-4d2b-85ea-913ccfd50f07 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:01.431494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8eb594-7717-402c-b523-015579cce0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:01.432347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb594-7717-402c-b523-015579cce0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:01.432632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb594-7717-402c-b523-015579cce0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:01.432912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8eb594-7717-402c-b523-015579cce0c0 None admin] PATH_INFO: `/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:01.434072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eb594-7717-402c-b523-015579cce0c0 None admin] RBAC: Authorizing `identity:get_project(project_id=6a54e1af04db408abd335dd5e3ee4a0b)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:01.435688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8eb594-7717-402c-b523-015579cce0c0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:01.437373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 602/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:51:01 2022] GET /identity/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:01.443503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:01.472645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:01.539426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1925-3ea0-43d0-b90a-e68688204a58 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:01.572324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6eba2-381f-4559-ba01-569a16bb7d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:01.572969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6eba2-381f-4559-ba01-569a16bb7d3a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:01.573255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6eba2-381f-4559-ba01-569a16bb7d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:01.573535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6eba2-381f-4559-ba01-569a16bb7d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:01.574362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6eba2-381f-4559-ba01-569a16bb7d3a None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=6a54e1af04db408abd335dd5e3ee4a0b, user.id=c5f491f5f1d24f4397cb25577d456c5e) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:51:01.574683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6eba2-381f-4559-ba01-569a16bb7d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:01.576137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6eba2-381f-4559-ba01-569a16bb7d3a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:01.581410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 583/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:51:01 2022] GET /identity/v3/role_assignments?user.id=c5f491f5f1d24f4397cb25577d456c5e&scope.project.id=6a54e1af04db408abd335dd5e3ee4a0b&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:03.571390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f04f-b9dc-4ccf-8309-8a224e87bd97 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:03.571907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f04f-b9dc-4ccf-8309-8a224e87bd97 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:03.572013 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f04f-b9dc-4ccf-8309-8a224e87bd97 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:03.573316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 603/1186] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:51:03.578579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ad18-98dd-41f2-a25f-2fe17eee51fb None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:03.579061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ad18-98dd-41f2-a25f-2fe17eee51fb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:03.579155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ad18-98dd-41f2-a25f-2fe17eee51fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:03.595335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f757ad18-98dd-41f2-a25f-2fe17eee51fb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:03.596502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f757ad18-98dd-41f2-a25f-2fe17eee51fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:03.660035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 584/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:51:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:51:03.683207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7f04f-b9dc-4ccf-8309-8a224e87bd97 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:03.757529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:03.779618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7f04f-b9dc-4ccf-8309-8a224e87bd97 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:03.812650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:03.813418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:03.813698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:03.813968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:03.823595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:51:03.831114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:51:03.832236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:51:03.833283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 604/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:51:03.838427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ad18-98dd-41f2-a25f-2fe17eee51fb None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:03.864487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:03.934060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ad18-98dd-41f2-a25f-2fe17eee51fb None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:03.966046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:03.966689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:03.966998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:03.967275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:03.968005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:51:03.968307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:03.969654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:03.977885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 585/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:03.983499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:04.079575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef29f-dfb9-4a32-b03a-9352f1edb6f9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:04.112127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:04.112969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:04.113255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:04.113534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] PATH_INFO: `/v3/users/c5f491f5f1d24f4397cb25577d456c5e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:04.114699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c5f491f5f1d24f4397cb25577d456c5e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:04.116161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:04.117729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 605/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:51:03 2022] GET /identity/v3/users/c5f491f5f1d24f4397cb25577d456c5e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:04.123128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:04.207516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:04.219287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08364cb3-5b42-4274-9f3c-c8e66a047508 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:04.252340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d41d9c-b634-478c-89c7-36929bcc12da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:04.253179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d41d9c-b634-478c-89c7-36929bcc12da None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:04.253462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d41d9c-b634-478c-89c7-36929bcc12da None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:04.253739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d41d9c-b634-478c-89c7-36929bcc12da None admin] PATH_INFO: `/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:04.254924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d41d9c-b634-478c-89c7-36929bcc12da None admin] RBAC: Authorizing `identity:get_project(project_id=6a54e1af04db408abd335dd5e3ee4a0b)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:04.256379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d41d9c-b634-478c-89c7-36929bcc12da None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:04.258044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 586/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:51:04 2022] GET /identity/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:04.263745 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:04.267408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:04.360632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307c335-f5cd-416c-b3d0-45490256f6f6 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:04.392677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677953e-81cb-496e-aee7-7869d65e8dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:04.393541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677953e-81cb-496e-aee7-7869d65e8dc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:04.393819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677953e-81cb-496e-aee7-7869d65e8dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:04.394089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677953e-81cb-496e-aee7-7869d65e8dc3 None admin] PATH_INFO: `/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b/users/c5f491f5f1d24f4397cb25577d456c5e/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:04.396001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677953e-81cb-496e-aee7-7869d65e8dc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a54e1af04db408abd335dd5e3ee4a0b, user_id=c5f491f5f1d24f4397cb25577d456c5e, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:04.398017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677953e-81cb-496e-aee7-7869d65e8dc3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:04.472692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 606/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:51:04 2022] PUT /identity/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b/users/c5f491f5f1d24f4397cb25577d456c5e/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:51:06.468816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bdf8-97c7-46b2-9c76-20b1bf301794 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:06.469316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bdf8-97c7-46b2-9c76-20b1bf301794 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:06.469432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593bdf8-97c7-46b2-9c76-20b1bf301794 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:06.470725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 587/1193] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:51:06.475983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061b66-dbd9-49bc-953a-4c1f3eb64149 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:06.476370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061b66-dbd9-49bc-953a-4c1f3eb64149 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:06.476581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061b66-dbd9-49bc-953a-4c1f3eb64149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:06.493652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4d061b66-dbd9-49bc-953a-4c1f3eb64149 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:51:06.494847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4d061b66-dbd9-49bc-953a-4c1f3eb64149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:51:06.551344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:06.559842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 607/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:51:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:51:06.582898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593bdf8-97c7-46b2-9c76-20b1bf301794 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:06.682061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593bdf8-97c7-46b2-9c76-20b1bf301794 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:06.714816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:06.715612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:06.715897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:06.716175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:06.726466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:51:06.734224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:51:06.735381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:51:06.736549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 588/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:51:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:51:06.741918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061b66-dbd9-49bc-953a-4c1f3eb64149 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:06.836275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061b66-dbd9-49bc-953a-4c1f3eb64149 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:06.869373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:06.870021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:06.870300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:06.870572 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:06.871340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:51:06.871646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:06.872983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:06.880658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 608/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:51:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:06.886216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:06.904655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:06.983855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab3f9d-c6a8-43e9-a6d4-f517627da9cd None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.015680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.016529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.016813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.017088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] PATH_INFO: `/v3/users/c5f491f5f1d24f4397cb25577d456c5e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.018260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] RBAC: Authorizing `identity:get_user(user_id=c5f491f5f1d24f4397cb25577d456c5e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.019705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.021294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 589/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 22 08:51:06 2022] GET /identity/v3/users/c5f491f5f1d24f4397cb25577d456c5e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:07.027496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.080834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:07.123324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591ca52-b6de-4c39-b546-61910828666c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.155388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.156017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.156304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.156582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.220017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.221432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.276806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:07.319560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 609/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:51:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:51:07.332791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.413855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:07.429576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d569-1026-4ddb-afe8-bb4172a07e04 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.461954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e2b50-616d-4fbd-b68e-69c1e033adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.462801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2b50-616d-4fbd-b68e-69c1e033adac None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.463115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2b50-616d-4fbd-b68e-69c1e033adac None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.463387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2b50-616d-4fbd-b68e-69c1e033adac None admin] PATH_INFO: `/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.464535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e2b50-616d-4fbd-b68e-69c1e033adac None admin] RBAC: Authorizing `identity:get_project(project_id=6a54e1af04db408abd335dd5e3ee4a0b)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.465942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e2b50-616d-4fbd-b68e-69c1e033adac None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.467629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 590/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 22 08:51:07 2022] GET /identity/v3/projects/6a54e1af04db408abd335dd5e3ee4a0b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:07.473716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:51:07.570162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52948e0f-bedb-430c-a587-43fe78eddcd2 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:51:07.602554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff46fb1-6cf2-418c-83fc-3a8b8d5e9067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:51:07.603217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff46fb1-6cf2-418c-83fc-3a8b8d5e9067 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:51:07.603507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff46fb1-6cf2-418c-83fc-3a8b8d5e9067 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:51:07.603787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff46fb1-6cf2-418c-83fc-3a8b8d5e9067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:51:07.604624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff46fb1-6cf2-418c-83fc-3a8b8d5e9067 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=6a54e1af04db408abd335dd5e3ee4a0b, user.id=c5f491f5f1d24f4397cb25577d456c5e) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:51:07.604938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff46fb1-6cf2-418c-83fc-3a8b8d5e9067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:51:07.606365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff46fb1-6cf2-418c-83fc-3a8b8d5e9067 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:51:07.612292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 610/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:51:07 2022] GET /identity/v3/role_assignments?user.id=c5f491f5f1d24f4397cb25577d456c5e&scope.project.id=6a54e1af04db408abd335dd5e3ee4a0b&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:51:17.457908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=24 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:51:17.609788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:19.364028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5cf1-7a90-40b3-b043-7029370380e0 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:19.364466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5cf1-7a90-40b3-b043-7029370380e0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:19.364573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5cf1-7a90-40b3-b043-7029370380e0 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:19.365982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 591/1201] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:19.371255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf913-3b78-407e-815f-86fcb4f9b51f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:19.371673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf913-3b78-407e-815f-86fcb4f9b51f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:19.371823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf913-3b78-407e-815f-86fcb4f9b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:19.391607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a2ecf913-3b78-407e-815f-86fcb4f9b51f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:19.392802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a2ecf913-3b78-407e-815f-86fcb4f9b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:19.458759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 611/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:19.483433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f5cf1-7a90-40b3-b043-7029370380e0 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:19.584457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f5cf1-7a90-40b3-b043-7029370380e0 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:19.618176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:19.618897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:19.619187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:19.619466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:19.630226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:19.631733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:19.649286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:19.650429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:19.651684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:19.651684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:19.651684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:19.651684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:19.651684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 592/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:19.656660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecf913-3b78-407e-815f-86fcb4f9b51f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:19.754672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecf913-3b78-407e-815f-86fcb4f9b51f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:19.782026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:19.787493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3d8a-e9cd-489e-811f-6e814ed1edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:19.788152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3d8a-e9cd-489e-811f-6e814ed1edb6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:19.788440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3d8a-e9cd-489e-811f-6e814ed1edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:19.788721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3d8a-e9cd-489e-811f-6e814ed1edb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:19.789441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3d8a-e9cd-489e-811f-6e814ed1edb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:19.789750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3d8a-e9cd-489e-811f-6e814ed1edb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:19.791162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3d8a-e9cd-489e-811f-6e814ed1edb6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:19.802392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 612/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:19.808288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:19.860506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:19.910324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764f50-56ae-46bc-a2a6-f8250350a289 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:19.950895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d092e-8d39-44bb-8e5f-82975715314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:19.951587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d092e-8d39-44bb-8e5f-82975715314d None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:19.951868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d092e-8d39-44bb-8e5f-82975715314d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:19.952144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d092e-8d39-44bb-8e5f-82975715314d None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:19.952845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d092e-8d39-44bb-8e5f-82975715314d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:19.954321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d092e-8d39-44bb-8e5f-82975715314d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:20.098870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 593/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 22 08:52:19 2022] POST /identity/v3/users => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:52:22.170490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3e09a-1f00-43bf-80d0-f71d03d7e8a5 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.171069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3e09a-1f00-43bf-80d0-f71d03d7e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.171069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3e09a-1f00-43bf-80d0-f71d03d7e8a5 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.172440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 613/1206] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:22.177648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280770-642b-4823-8eb2-a976734d530c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.178077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280770-642b-4823-8eb2-a976734d530c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.178200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280770-642b-4823-8eb2-a976734d530c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.194507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-92280770-642b-4823-8eb2-a976734d530c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:22.195741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-92280770-642b-4823-8eb2-a976734d530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:22.263765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 594/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:52:22.287643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3e09a-1f00-43bf-80d0-f71d03d7e8a5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:22.388702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3e09a-1f00-43bf-80d0-f71d03d7e8a5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:22.423162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:22.423804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.424097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.424482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.434168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:52:22.442403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:22.443533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:22.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 614/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:52:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:22.449575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92280770-642b-4823-8eb2-a976734d530c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:22.489374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:22.546752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92280770-642b-4823-8eb2-a976734d530c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:22.579617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:22.580282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.580569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.580843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.582125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:22.582428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:22.583813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:22.591844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 595/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:52:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:22.597373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:22.647373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:22.696343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e83b3-4a13-4674-8f67-1697fa1271c7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:22.727729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:22.728533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.728815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.729093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.740240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:22.741704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:22.758732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:22.765110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:22.766075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:22.766075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:22.766075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:22.766075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:22.766075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 615/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:22.766366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:22.861083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:22.864505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72f936-7ba8-4caa-b322-e0e66836b0ec None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:22.897266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:22.897920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.898206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.898483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.899236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:22.899560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:22.900960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:22.912106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 596/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:22.917882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:23.020840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7fa68-9cf8-4355-9886-1f75ca5f5aef None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:23.022263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:23.054283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:23.055108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:23.055391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:23.055664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:23.062630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:23.064885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:52:23.078315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:23.079469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:23.080651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 616/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:23.085336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:23.184009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ba5ce-5622-4514-aeb1-0922d0a331cd None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:23.216549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:23.217212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:23.217495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:23.217767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:23.218598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:23.218934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:23.220431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:23.241286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 597/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 22 08:52:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:23.247126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:23.346607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9fc9-a8eb-4ccd-a8c1-6e85de5aa7ac None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:23.381022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:23.381669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:23.381961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:23.382243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:23.411715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:23.448484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:23.449959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:23.545516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 617/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:52:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:52:23.552015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:23.571337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:23.650997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc32e-34ff-4746-b5fc-b89cf6b1c933 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:23.683800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:23.684580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:23.684867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:23.685146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:23.695775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:23.697328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:23.715027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:23.715942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:23.716861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:23.716861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:23.716861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:23.716861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:23.716861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 598/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:23.722618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:23.783356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:23.820299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356e332-2913-46f3-bcba-2d4f98e4a0da None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:23.852254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:23.852910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:23.855323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:23.855323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:23.855323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:23.855323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:23.855813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:23.867499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 618/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:23.872893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:23.941622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:23.971595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b593c7-6db4-4c7e-ab7e-cf4b913c27cf None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:24.004985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:24.005767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:24.006053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:24.006332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:24.012904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:24.014333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:52:24.028280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:24.029371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:24.030268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 599/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:24.035502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:24.134644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0001ac-ad73-4178-a990-9d3ebd522ad1 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:24.156985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:24.168489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150c50b-8faf-429c-b6e2-fa3b49e07f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:24.169141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c50b-8faf-429c-b6e2-fa3b49e07f2a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:24.169422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c50b-8faf-429c-b6e2-fa3b49e07f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:24.169695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c50b-8faf-429c-b6e2-fa3b49e07f2a None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:24.170468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c50b-8faf-429c-b6e2-fa3b49e07f2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:24.170775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c50b-8faf-429c-b6e2-fa3b49e07f2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:24.172290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c50b-8faf-429c-b6e2-fa3b49e07f2a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:24.183378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 619/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:24.189476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:24.288210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec92c8-12db-4422-8a69-c6aaa4cf10be None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:24.314817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:24.320235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5db91-c7f8-4b40-b39f-9c7d0370bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:24.320883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5db91-c7f8-4b40-b39f-9c7d0370bdac None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:24.321164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5db91-c7f8-4b40-b39f-9c7d0370bdac None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:24.321442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5db91-c7f8-4b40-b39f-9c7d0370bdac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:24.322270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5db91-c7f8-4b40-b39f-9c7d0370bdac None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=dd20d4b992c84434ba0ab81046009e09) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:24.322585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5db91-c7f8-4b40-b39f-9c7d0370bdac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:24.324111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5db91-c7f8-4b40-b39f-9c7d0370bdac None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:24.330486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 600/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:52:24 2022] GET /identity/v3/role_assignments?user.id=dd20d4b992c84434ba0ab81046009e09&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:26.321779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf39f7-ff92-4d19-8759-0d6e836dabea None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.322359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf39f7-ff92-4d19-8759-0d6e836dabea None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.322359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf39f7-ff92-4d19-8759-0d6e836dabea None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.323757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 620/1220] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:26.329041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0ab9-534b-40c1-828a-94ce320eea1f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.329456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0ab9-534b-40c1-828a-94ce320eea1f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.329610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea0ab9-534b-40c1-828a-94ce320eea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.346833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-0dea0ab9-534b-40c1-828a-94ce320eea1f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:26.348099 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0dea0ab9-534b-40c1-828a-94ce320eea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:26.413911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 601/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:52:26.437787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf39f7-ff92-4d19-8759-0d6e836dabea None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:26.538284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf39f7-ff92-4d19-8759-0d6e836dabea None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:26.572290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:26.573036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.573316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.573589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.583335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:52:26.590883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:26.591955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:26.593271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 621/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:52:26.598169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea0ab9-534b-40c1-828a-94ce320eea1f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:26.696791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea0ab9-534b-40c1-828a-94ce320eea1f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:26.719118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:26.729881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:26.730538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.730850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.731128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.732126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:26.732435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:26.733851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:26.742081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 602/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:52:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:26.747787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:26.791087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:26.844829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae7073-4ecf-498d-9780-a8bb56e2ea70 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:26.877964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:26.878748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.879267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.879605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.890453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:26.894109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:26.908428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:26.910012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:26.910972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:26.910972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:26.910972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:26.910972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:26.910972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 622/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:26.917203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:27.013692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a2cd5-86b4-47e2-8b2b-837cf1f1ec14 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:27.047736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:27.048387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:27.048672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:27.048953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:27.049697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:27.050005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:27.051398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:27.062727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 603/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:27.068873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:27.160417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:27.167036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca2a6-9ee1-441e-b229-19a1524aed4c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:27.199741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:27.200520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:27.200801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:27.201071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:27.208082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:27.209547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:52:27.223724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:27.224942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:27.226470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 623/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:27.231360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:27.277835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:27.328954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07b07c-c530-4ed0-a5ae-3fa72eccf2be None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:27.366315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:27.367010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:27.367297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:27.367576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:27.368410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:27.368721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:27.370148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:27.386952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 604/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 22 08:52:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:27.392548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:27.491486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9b8c-8af4-4175-b5fe-b6b90cd36e33 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:27.525001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:27.525831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:27.526116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:27.526392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:27.536158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:27.537630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:27.554550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:27.555568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:27.556484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:27.556484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:27.556484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:27.556484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:27.556484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 624/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:27.561425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:27.660184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e565c0-3912-4c00-ae58-470d07892863 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:27.662458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:27.696338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:27.697030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:27.697424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:27.697703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:27.698420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:27.698752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:27.700750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:27.714776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 605/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:27.720460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:27.729602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:27.821808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1cd2d-9fa6-4c0a-b5d7-8a694a99973e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:27.854654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:27.855466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:27.855753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:27.856029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:27.863255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:27.864679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:52:27.879099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:27.880186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:27.881243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 625/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:27.886121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:27.987694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca3a8a-99cd-4a29-ae78-79903d68ae70 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:28.032333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182860a-388f-459b-a7f0-afb45c0192cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:28.033003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182860a-388f-459b-a7f0-afb45c0192cc None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:28.033284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182860a-388f-459b-a7f0-afb45c0192cc None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:28.033560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182860a-388f-459b-a7f0-afb45c0192cc None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:28.034381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182860a-388f-459b-a7f0-afb45c0192cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:28.034688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182860a-388f-459b-a7f0-afb45c0192cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:28.036151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182860a-388f-459b-a7f0-afb45c0192cc None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:28.049250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 606/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:28.055754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:28.120696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:28.154449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d90b00-00c6-45ee-9cf2-f968d45d24a0 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:28.186201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11311e61-188c-40c7-93aa-65efd376ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:28.187301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11311e61-188c-40c7-93aa-65efd376ea5d None admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:28.187758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11311e61-188c-40c7-93aa-65efd376ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:28.188493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11311e61-188c-40c7-93aa-65efd376ea5d None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/dd20d4b992c84434ba0ab81046009e09/roles/cc51cc5968f24b14a1e87199902c9b71` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:28.202279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11311e61-188c-40c7-93aa-65efd376ea5d None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=dd20d4b992c84434ba0ab81046009e09, role_id=cc51cc5968f24b14a1e87199902c9b71)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:28.206395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11311e61-188c-40c7-93aa-65efd376ea5d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:28.312348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 626/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:52:28 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/dd20d4b992c84434ba0ab81046009e09/roles/cc51cc5968f24b14a1e87199902c9b71 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:52:30.317251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dfeb0-fa00-4652-838d-a5b25fe02473 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.317805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dfeb0-fa00-4652-838d-a5b25fe02473 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.317805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dfeb0-fa00-4652-838d-a5b25fe02473 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.319194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 607/1233] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:30.324346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06a776-f8fd-4871-b7c3-5a9794a20847 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.324745 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06a776-f8fd-4871-b7c3-5a9794a20847 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.324914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06a776-f8fd-4871-b7c3-5a9794a20847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.341626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0b06a776-f8fd-4871-b7c3-5a9794a20847 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:30.342847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0b06a776-f8fd-4871-b7c3-5a9794a20847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:30.413794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 627/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:30.438402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dfeb0-fa00-4652-838d-a5b25fe02473 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:30.463912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:30.539110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dfeb0-fa00-4652-838d-a5b25fe02473 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:30.579666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:30.580924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.581412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.581873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.593450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:52:30.607739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:30.616333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:30.617399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 608/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 22 08:52:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:30.618292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06a776-f8fd-4871-b7c3-5a9794a20847 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:30.661746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:30.712780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06a776-f8fd-4871-b7c3-5a9794a20847 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:30.745811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:30.746477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.746766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.747073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.747817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:30.748122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:30.749491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:30.757319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 628/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 22 08:52:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:52:30.763083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:30.849242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:30.865171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed47136-9c4c-43af-aa67-ce1407268d27 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:30.897998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:30.898781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.899093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.899369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.909561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:30.911024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:30.927858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:30.938572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:30.939755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:30.939755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:30.939755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:30.939755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:30.939755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 609/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:30.940268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:31.032370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa311f8-482d-43f7-89d5-5ab32d6e7e4c None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:31.041461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:31.064777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:31.065437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:31.065721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:31.066001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:31.066720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:31.067065 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:31.068428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:31.079660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 629/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:31.085781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:31.183842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589a69-99f1-40d1-98b0-b2aeb9f22801 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:31.216803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:31.218403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:31.218403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:31.218403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:31.220864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:31.225948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:31.227417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:52:31.242295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:31.249988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:31.251173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 610/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:31.251964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:31.349348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02501071-fc5b-4ce3-b108-d4281c822b1e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:31.384282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:31.385015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:31.385295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:31.385574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:31.386403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:31.386707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:31.388159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:31.405715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 630/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 22 08:52:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:31.411355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:31.508311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b451fbe-eb96-4da5-8b4a-943009824d0e None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:31.541229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:31.541875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:31.542165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:31.542448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:31.602642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:31.609257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:31.610834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:31.706117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 611/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:52:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:52:31.712114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:31.740333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:31.809677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99a62f-15cd-49be-83b6-da47ed9fe28f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:31.842865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:31.843647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:31.843930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:31.844208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:31.854770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:31.856216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:31.874197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:31.875323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:31.876452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:31.876452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:31.876452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:31.876452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:31.876452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 631/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:31.881645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:31.973591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:31.979195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad92eb3-fdb6-4955-bca2-b5bb5fff8bdd None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:32.012451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:32.013109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:32.013394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:32.013669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:32.014392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:32.014702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:32.016091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:32.026994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 612/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:32.032839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:32.110978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:32.131650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47ada3-9b07-4d34-8d1d-17ee5101887f None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:32.165223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:32.166059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:32.166341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:32.166618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:32.172990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:32.175078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:52:32.188280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:32.194854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:32.195959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 632/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:32.196631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:32.298145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1fe88-1414-4e52-b4d8-204aa4b0ae37 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:32.330165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ab1c3-ae1f-4677-bd41-30fd4a756424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:32.330859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ab1c3-ae1f-4677-bd41-30fd4a756424 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:32.331143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ab1c3-ae1f-4677-bd41-30fd4a756424 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:32.331417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ab1c3-ae1f-4677-bd41-30fd4a756424 None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:32.332205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ab1c3-ae1f-4677-bd41-30fd4a756424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:32.332513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ab1c3-ae1f-4677-bd41-30fd4a756424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:32.334025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ab1c3-ae1f-4677-bd41-30fd4a756424 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:32.345589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 613/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:52:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:32.352331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:32.450725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a954f-039e-4261-8cca-fddb0948b5f9 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:32.484723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150e130-95cf-41f9-a557-041d7ec6735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:32.485371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e130-95cf-41f9-a557-041d7ec6735e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:32.485652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e130-95cf-41f9-a557-041d7ec6735e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:32.485925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e130-95cf-41f9-a557-041d7ec6735e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:32.486735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150e130-95cf-41f9-a557-041d7ec6735e None admin] RBAC: Adding query filter params (role.id=cc51cc5968f24b14a1e87199902c9b71, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=dd20d4b992c84434ba0ab81046009e09) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:32.487070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150e130-95cf-41f9-a557-041d7ec6735e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:32.488580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150e130-95cf-41f9-a557-041d7ec6735e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:32.494361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 633/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:52:32 2022] GET /identity/v3/role_assignments?user.id=dd20d4b992c84434ba0ab81046009e09&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=cc51cc5968f24b14a1e87199902c9b71 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:34.540399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9540c-ca84-498e-ac25-3a46662a4809 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:34.540942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9540c-ca84-498e-ac25-3a46662a4809 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:34.540942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9540c-ca84-498e-ac25-3a46662a4809 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:34.542280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 614/1247] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:34.547525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b381-8812-4f69-bbd2-621f01d3a775 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:34.547917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b381-8812-4f69-bbd2-621f01d3a775 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:34.548092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b381-8812-4f69-bbd2-621f01d3a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:34.553670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:34.565241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3cd8b381-8812-4f69-bbd2-621f01d3a775 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:34.566412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3cd8b381-8812-4f69-bbd2-621f01d3a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:34.630978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 634/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:34.654692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9540c-ca84-498e-ac25-3a46662a4809 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:34.673234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:34.755730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9540c-ca84-498e-ac25-3a46662a4809 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:34.789109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:34.789892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:34.790180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:34.790465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:34.800273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:52:34.808089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:34.810393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:34.811266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 615/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:52:34.815809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8b381-8812-4f69-bbd2-621f01d3a775 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:34.915433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8b381-8812-4f69-bbd2-621f01d3a775 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:34.943578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:34.948398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:34.949063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:34.949347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:34.949622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:34.950363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:34.950669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:34.952063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:34.960756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 635/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:52:34.966625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:35.043553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:35.065503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914b3a-dd01-4730-81c0-46db979c87cf None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:35.098267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:35.099083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.099368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.099645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.111029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:35.112455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:35.129769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:35.130895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:35.137803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:35.137803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:35.137803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:35.137803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:35.137803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 616/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:35.138095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:35.235173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66baff-decb-4855-8904-7278948a8561 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:35.267640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:35.268993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.269279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.269559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.270277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:35.270592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:35.271983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:35.284218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 636/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:52:35.289865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:35.392035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b8a2-4ea7-4193-99b7-6cfd4834c85b None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:35.417216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:35.425282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:35.426083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.426367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.426673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.434113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:35.435635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:52:35.450546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:35.451679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:35.452635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 617/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:35.457739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:35.512787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:35.555930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09108-cb96-42d4-be98-82a9bf92d5c4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:35.589787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:35.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.590735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.591130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.591958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:35.592270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:35.593705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:35.612821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 637/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 22 08:52:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:35.618514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:35.716708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0dc8b-5f92-48bc-aad3-3e938ca509dd None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:35.750122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:35.750766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.751079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.751363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.806125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:35.818062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:35.819541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:35.922147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 618/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:52:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:52:35.928627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:36.024473 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38e544-ac6d-4a8e-9531-66fea4428511 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:36.037537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:36.057725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:36.058448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:36.058730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:36.059037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:36.068534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:36.069943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:36.086469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:36.087526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:36.092895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:36.092895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:36.092895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:36.092895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:36.092895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 638/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:36.093285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:36.179717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:36.191823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890de1-870f-4f6d-bdca-2bbb8dbd1a92 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:36.225638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:36.226292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:36.226581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:36.226888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:36.227609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:36.227922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:36.229277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:36.240390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 619/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:36.245954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:36.344041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9ece0-6fc1-4b99-a267-f1ba6268e66a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:36.378500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:36.379322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:36.379609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:36.379886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:36.386362 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:36.388484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:52:36.401680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:36.402737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:36.403877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 639/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:36.409383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:36.510984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a778-10b7-4c2d-aba2-fed55b51a765 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:36.543490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808dff1-1d88-4a1f-a6ba-37cc387ed40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:36.544151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808dff1-1d88-4a1f-a6ba-37cc387ed40f None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:36.544435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808dff1-1d88-4a1f-a6ba-37cc387ed40f None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:36.544717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808dff1-1d88-4a1f-a6ba-37cc387ed40f None admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:36.545525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808dff1-1d88-4a1f-a6ba-37cc387ed40f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:36.545833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808dff1-1d88-4a1f-a6ba-37cc387ed40f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:36.547292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808dff1-1d88-4a1f-a6ba-37cc387ed40f None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:36.559183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 620/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:52:36.565720 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:36.591673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:36.665060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd7084-dc15-4823-a7c3-2fb43fd8cf3e None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:36.709200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20b65f-e1bd-483e-9257-2c0e58fb7d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:36.713452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20b65f-e1bd-483e-9257-2c0e58fb7d73 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:36.713744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20b65f-e1bd-483e-9257-2c0e58fb7d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:36.714019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20b65f-e1bd-483e-9257-2c0e58fb7d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:36.714867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20b65f-e1bd-483e-9257-2c0e58fb7d73 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=dd20d4b992c84434ba0ab81046009e09) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:36.715177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20b65f-e1bd-483e-9257-2c0e58fb7d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:36.716679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20b65f-e1bd-483e-9257-2c0e58fb7d73 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:36.722154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 640/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:52:36 2022] GET /identity/v3/role_assignments?user.id=dd20d4b992c84434ba0ab81046009e09&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:38.734090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543de67-7c6c-445a-affb-527f4621b964 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:38.734630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543de67-7c6c-445a-affb-527f4621b964 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:38.734630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543de67-7c6c-445a-affb-527f4621b964 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:38.736026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 621/1261] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:38.741277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d2734-ed6d-4e56-9bd9-f8bca2229734 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:38.741703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d2734-ed6d-4e56-9bd9-f8bca2229734 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:38.741838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d2734-ed6d-4e56-9bd9-f8bca2229734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:38.758888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8d7d2734-ed6d-4e56-9bd9-f8bca2229734 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:38.760138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8d7d2734-ed6d-4e56-9bd9-f8bca2229734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:38.824422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 641/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:38.847988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543de67-7c6c-445a-affb-527f4621b964 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:38.858897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:38.953583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543de67-7c6c-445a-affb-527f4621b964 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:38.987168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:38.987876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:38.988156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:38.988428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:38.998078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:52:39.006340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:39.007502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:39.008573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 622/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:39.013703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d2734-ed6d-4e56-9bd9-f8bca2229734 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:39.032102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:39.109635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d2734-ed6d-4e56-9bd9-f8bca2229734 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:39.144916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:39.145583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:39.145872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:39.146153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:39.146927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:39.147236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:39.148607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:39.157082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 642/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:39.162914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:39.228852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:39.262905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86e747-d5e4-49f4-88c2-c27dcdf0a366 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:39.295129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:39.295911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:39.296193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:39.296464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:39.307179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:39.308601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:39.325664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:39.326771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:39.327967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:39.327967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:39.327967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:39.327967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:39.327967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 623/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:39.332717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:39.414010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:39.433015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec5d7-e473-4d2a-90e0-a9e210e781b3 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:39.467092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:39.467837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:39.468125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:39.468400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:39.469108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:39.469412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:39.471287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:39.482331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 643/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:39.488629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:39.587024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900074e4-465e-4e41-8982-917d6ec40aa4 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:39.605883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:39.619677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:39.620463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:39.620747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:39.621027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:39.628154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:39.629565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:52:39.643351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:39.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:39.645781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 624/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:39.650332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:39.748222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854054d9-99e7-47e4-9d4b-d1deb63e00b6 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:39.780681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:39.781341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:39.781623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:39.781899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:39.782718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:39.783051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:39.784985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:39.794065 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:39.802096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 644/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 22 08:52:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:39.807959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:39.906091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9935d0a-57b6-45a0-8a37-e79af3cd4d0c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:39.939906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50417-e018-437d-afb4-888733985a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:39.940900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50417-e018-437d-afb4-888733985a07 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:39.941257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50417-e018-437d-afb4-888733985a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:39.941543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50417-e018-437d-afb4-888733985a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:39.952827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b50417-e018-437d-afb4-888733985a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:39.954314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b50417-e018-437d-afb4-888733985a07 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-50b50417-e018-437d-afb4-888733985a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:39.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:39.973615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:39.975385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:39.975385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:39.975385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:39.975385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:39.975385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 625/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:39.979032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:40.077392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2153e-26db-4f20-a53a-ec8c0cdd244a None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:40.110913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:40.111595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:40.111876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:40.112147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:40.112851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:40.113155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:40.114492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:40.125250 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 645/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:40.130955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50417-e018-437d-afb4-888733985a07 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:40.162418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:40.228166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50417-e018-437d-afb4-888733985a07 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:40.262174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:40.263078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:40.263360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:40.263635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:40.270733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:40.272187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:52:40.286074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:40.287169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:40.288165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 626/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:40.293218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:40.350441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:40.390195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb5618-8acf-435a-8463-ec6b7ac2762d None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:40.423652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52533c1d-304a-473c-ba3f-0c927968ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:40.424345 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533c1d-304a-473c-ba3f-0c927968ad42 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:40.425108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533c1d-304a-473c-ba3f-0c927968ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:40.425390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533c1d-304a-473c-ba3f-0c927968ad42 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:40.426170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52533c1d-304a-473c-ba3f-0c927968ad42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:40.426484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52533c1d-304a-473c-ba3f-0c927968ad42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:40.427953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52533c1d-304a-473c-ba3f-0c927968ad42 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:40.440271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 646/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:40.446530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:40.538430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:40.546515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb4c87-bcf8-4b35-a9a1-4420d86cbe8d None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:40.580957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347726b-6471-4b32-b6ea-2c1d7b3c33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:40.581850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347726b-6471-4b32-b6ea-2c1d7b3c33a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:40.582180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347726b-6471-4b32-b6ea-2c1d7b3c33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:40.582467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347726b-6471-4b32-b6ea-2c1d7b3c33a9 None admin] PATH_INFO: `/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/dd20d4b992c84434ba0ab81046009e09/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:40.584503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347726b-6471-4b32-b6ea-2c1d7b3c33a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71bcfec571b4cc1862be949aa761fcb, user_id=dd20d4b992c84434ba0ab81046009e09, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:40.585933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347726b-6471-4b32-b6ea-2c1d7b3c33a9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:40.666198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 627/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 22 08:52:40 2022] PUT /identity/v3/projects/b71bcfec571b4cc1862be949aa761fcb/users/dd20d4b992c84434ba0ab81046009e09/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:52:42.663518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a4a9-ebe4-4b0e-8100-de8e90a4b139 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:42.664019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a4a9-ebe4-4b0e-8100-de8e90a4b139 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:42.664019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a4a9-ebe4-4b0e-8100-de8e90a4b139 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:42.665414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 647/1274] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:42.670451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5cae9-1421-43e5-b90e-19f1faedc53f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:42.670862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5cae9-1421-43e5-b90e-19f1faedc53f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:42.671104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5cae9-1421-43e5-b90e-19f1faedc53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:42.688323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-22f5cae9-1421-43e5-b90e-19f1faedc53f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:42.689516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-22f5cae9-1421-43e5-b90e-19f1faedc53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:42.754167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 628/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:42.777752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a4a9-ebe4-4b0e-8100-de8e90a4b139 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:42.878637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a4a9-ebe4-4b0e-8100-de8e90a4b139 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:42.895932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:42.912285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:42.913089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:42.913357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:42.919416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:42.923360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:52:42.930963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:42.932121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:42.934710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 648/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 22 08:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:42.938315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5cae9-1421-43e5-b90e-19f1faedc53f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:43.020461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:43.038169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5cae9-1421-43e5-b90e-19f1faedc53f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:43.087882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:43.088549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:43.088836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:43.089114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:43.089863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:43.090171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:43.091562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:43.100041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 629/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 22 08:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:43.105704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:43.206208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1901da5-394a-4897-b607-13ba8c2011ec None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:43.239367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:43.240144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:43.240427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:43.240701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:43.250972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:43.252915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:43.270068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:43.271210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:43.272347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:43.272347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:43.272347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:43.272347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:43.272347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 649/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:43.277105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:43.378374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9a91-0487-4766-90e3-439e087b2227 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:43.411886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:43.412543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:43.412830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:43.413107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:43.413831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:43.414141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:43.415528 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:43.427600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 630/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:52:43.433258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:43.464833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:43.533767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc73df-6cdd-4bb6-98cc-6623c9ffc0d7 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:43.566303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:43.567122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:43.567406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:43.567682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:43.574596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:43.576316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:52:43.590449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:43.591604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:43.593092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 650/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:43.598031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:43.601983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:43.698562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02538bc-2319-447c-a38a-2997eba6c67c None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:43.731028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:43.731879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:43.732159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:43.732429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:43.733253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:43.733557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:43.734994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:43.752321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 631/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 22 08:52:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:43.758134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:43.846804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:43.856443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43435d88-c7b5-4b61-b432-ed0c2d8e9237 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:43.889077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:43.889718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:43.890005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:43.890279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:43.957996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:43.959483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:44.045070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:44.054710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 651/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 22 08:52:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:52:44.060445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:44.121323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:44.158224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a74b-906f-4846-b02c-14f6c5a254ef None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:44.190776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:44.191636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.191920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.192194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.202608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:44.204080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:52:44.221729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:44.222868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:44.224124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:52:44.224124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:52:44.224124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:52:44.224124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:44.224124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 632/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 08:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:44.228585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:44.324492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed6289-4458-467a-8949-879cf51d53b5 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:44.360660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:44.361321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.361606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.362449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.363212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:44.363520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:44.364889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:44.375962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 652/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 22 08:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:44.382121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:44.478497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9833268-7797-4672-a80a-76f9c8066643 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:44.493128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:44.512695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:44.513582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.513869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.514147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.520684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:44.522116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:52:44.536386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:44.541190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: ERROR keystone.server.flask.application Jun 22 08:52:44.542408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 633/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 22 08:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:44.543668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:44.592222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:44.640491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db7865-4ef5-4b2a-851d-6009a1ad35c4 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:44.672235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4923-dfdc-4edf-ab27-cfad8da41ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:44.672882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4923-dfdc-4edf-ab27-cfad8da41ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.673164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4923-dfdc-4edf-ab27-cfad8da41ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.673494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4923-dfdc-4edf-ab27-cfad8da41ce3 None admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.674799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b4923-dfdc-4edf-ab27-cfad8da41ce3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:44.675135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b4923-dfdc-4edf-ab27-cfad8da41ce3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:44.676542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b4923-dfdc-4edf-ab27-cfad8da41ce3 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:44.688396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 653/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 22 08:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:44.694981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:44.792415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac525f-8d91-4ebf-a3d4-a01a17a24e26 None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:44.825720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b140d-5416-4e64-8b54-ba0b3591c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:44.826363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b140d-5416-4e64-8b54-ba0b3591c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.826648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b140d-5416-4e64-8b54-ba0b3591c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.826956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b140d-5416-4e64-8b54-ba0b3591c4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.827783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b140d-5416-4e64-8b54-ba0b3591c4c9 None admin] RBAC: Adding query filter params (role.id=c37baaaba52a4e97b6df7fbdc86df1db, scope.project.id=b71bcfec571b4cc1862be949aa761fcb, user.id=dd20d4b992c84434ba0ab81046009e09) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:44.828096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b140d-5416-4e64-8b54-ba0b3591c4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:44.829517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b140d-5416-4e64-8b54-ba0b3591c4c9 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:44.835232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 634/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 22 08:52:44 2022] GET /identity/v3/role_assignments?user.id=dd20d4b992c84434ba0ab81046009e09&scope.project.id=b71bcfec571b4cc1862be949aa761fcb&role.id=c37baaaba52a4e97b6df7fbdc86df1db => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:46.943405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a37d-d23f-464b-9ee7-d0da05239650 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:46.943974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a37d-d23f-464b-9ee7-d0da05239650 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:46.943974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a37d-d23f-464b-9ee7-d0da05239650 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:46.945389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 654/1288] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:46.951069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb608d1-257c-40d7-a83e-060aaa3dd744 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:46.951565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb608d1-257c-40d7-a83e-060aaa3dd744 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:46.951769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb608d1-257c-40d7-a83e-060aaa3dd744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:46.969230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6eb608d1-257c-40d7-a83e-060aaa3dd744 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:46.970423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6eb608d1-257c-40d7-a83e-060aaa3dd744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:47.001530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:47.038997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 635/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:47.062233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a37d-d23f-464b-9ee7-d0da05239650 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:47.163594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a37d-d23f-464b-9ee7-d0da05239650 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:47.173848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:47.196732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:47.197457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:47.197744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:47.198020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:47.198694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:47.200077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:47.211775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:47.213252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:47.214478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 655/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:52:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:47.218972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb608d1-257c-40d7-a83e-060aaa3dd744 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:47.316441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb608d1-257c-40d7-a83e-060aaa3dd744 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:47.350490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed194-2445-4f09-80d7-24bc8ec48e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:47.351184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed194-2445-4f09-80d7-24bc8ec48e5d None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:47.351474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed194-2445-4f09-80d7-24bc8ec48e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:47.351756 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed194-2445-4f09-80d7-24bc8ec48e5d None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:47.352525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed194-2445-4f09-80d7-24bc8ec48e5d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:47.352836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed194-2445-4f09-80d7-24bc8ec48e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:47.354237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ed194-2445-4f09-80d7-24bc8ec48e5d None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:47.359497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 636/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 22 08:52:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:47.365149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:47.463308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa259-eaf9-4e0f-a826-e8f8e7bca027 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:47.496406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f681383-6e15-4d7f-aab8-548a545b0e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:47.497052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681383-6e15-4d7f-aab8-548a545b0e7d None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:47.497332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681383-6e15-4d7f-aab8-548a545b0e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:47.497604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681383-6e15-4d7f-aab8-548a545b0e7d None admin] PATH_INFO: `/v3/services` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:47.498294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f681383-6e15-4d7f-aab8-548a545b0e7d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:47.498594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f681383-6e15-4d7f-aab8-548a545b0e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:47.500036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f681383-6e15-4d7f-aab8-548a545b0e7d None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:47.505730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 656/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 22 08:52:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:49.518705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffea59-a132-43ee-9d21-9ae1e46f53ed None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:49.519288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffea59-a132-43ee-9d21-9ae1e46f53ed None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:49.519571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffea59-a132-43ee-9d21-9ae1e46f53ed None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:49.521728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 637/1293] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:49.527047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069760-a5d8-4819-8741-25314de9c065 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:49.527468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069760-a5d8-4819-8741-25314de9c065 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:49.527603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069760-a5d8-4819-8741-25314de9c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:49.544165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-bf069760-a5d8-4819-8741-25314de9c065 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:49.545364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bf069760-a5d8-4819-8741-25314de9c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:49.573919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:49.611122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 657/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:49.635395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffea59-a132-43ee-9d21-9ae1e46f53ed None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:49.665764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:49.732452 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffea59-a132-43ee-9d21-9ae1e46f53ed None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:49.765721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f60c2-ceb6-438d-8a4b-9b2f16077aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:49.766370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f60c2-ceb6-438d-8a4b-9b2f16077aaa None admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:49.766649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f60c2-ceb6-438d-8a4b-9b2f16077aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:49.766951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f60c2-ceb6-438d-8a4b-9b2f16077aaa None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:49.767681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f60c2-ceb6-438d-8a4b-9b2f16077aaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:49.769026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f60c2-ceb6-438d-8a4b-9b2f16077aaa None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:49.848584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 638/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 22 08:52:49 2022] POST /identity/v3/services => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:52:51.915920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415816-93b1-4dc7-baa0-81b04dd07c91 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:51.916499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415816-93b1-4dc7-baa0-81b04dd07c91 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:51.916499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415816-93b1-4dc7-baa0-81b04dd07c91 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:51.917861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 658/1296] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:51.922887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d564-7a27-4927-b966-a49e42b6049c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:51.923288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d564-7a27-4927-b966-a49e42b6049c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:51.923439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d564-7a27-4927-b966-a49e42b6049c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:51.940864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6833d564-7a27-4927-b966-a49e42b6049c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:51.942127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6833d564-7a27-4927-b966-a49e42b6049c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:52.012488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 639/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:52:52.035186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415816-93b1-4dc7-baa0-81b04dd07c91 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:52.135015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415816-93b1-4dc7-baa0-81b04dd07c91 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:52.167233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:52.167950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:52.168229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:52.168500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:52.169140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:52.170558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:52.182446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:52.183493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:52.184380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 659/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:52:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:52.190288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d564-7a27-4927-b966-a49e42b6049c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:52.208300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:52.288462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d564-7a27-4927-b966-a49e42b6049c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:52.322071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:52.322726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:52.323045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:52.323329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:52.324035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] RBAC: Adding query filter params (name=placement) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:52.324355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:52.325741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:52.330769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 640/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 22 08:52:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:52.336821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:52.370015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:52.439313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641cd7f-253b-45bc-814b-f811eecda872 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:52.472505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2603a-133f-4c5c-b6ed-e139ef352da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:52.473161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2603a-133f-4c5c-b6ed-e139ef352da5 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:52.473482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2603a-133f-4c5c-b6ed-e139ef352da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:52.473906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2603a-133f-4c5c-b6ed-e139ef352da5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:52.475185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2603a-133f-4c5c-b6ed-e139ef352da5 None admin] RBAC: Adding query filter params (interface=public, service_id=c68b29ed520b4896b5adbb8b7b1d71f1, region_id=RegionOne) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:52.475655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2603a-133f-4c5c-b6ed-e139ef352da5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:52.477824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2603a-133f-4c5c-b6ed-e139ef352da5 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:52.484283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 660/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 22 08:52:52 2022] GET /identity/v3/endpoints?service_id=c68b29ed520b4896b5adbb8b7b1d71f1&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:52.490865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:52.571257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:52.589555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b007fc7-a3c6-4cfc-822c-0b6b71da68ec None admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:52.622813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bbf47-9072-4173-b50f-2a1520df6f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:52.623585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbf47-9072-4173-b50f-2a1520df6f4a None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:52.623873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbf47-9072-4173-b50f-2a1520df6f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:52.624149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbf47-9072-4173-b50f-2a1520df6f4a None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:52.624828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bbf47-9072-4173-b50f-2a1520df6f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:52.626174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bbf47-9072-4173-b50f-2a1520df6f4a None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:52.632940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 641/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 22 08:52:52 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:52:54.662400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc725-dfda-4250-9f19-457f3c875e2b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:54.662938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc725-dfda-4250-9f19-457f3c875e2b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:54.662938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc725-dfda-4250-9f19-457f3c875e2b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:54.664380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 661/1302] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:54.669431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abd9c1-3346-412f-8aed-1070ff92757d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:54.669806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abd9c1-3346-412f-8aed-1070ff92757d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:54.670079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abd9c1-3346-412f-8aed-1070ff92757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:54.687054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e5abd9c1-3346-412f-8aed-1070ff92757d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:54.688241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e5abd9c1-3346-412f-8aed-1070ff92757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:54.753296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 642/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:52:54.776641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc725-dfda-4250-9f19-457f3c875e2b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:54.868852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:54.875155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc725-dfda-4250-9f19-457f3c875e2b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:54.908041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:54.908836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:54.909122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:54.909399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:54.910044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:54.911556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:52:54.924339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:52:54.925536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application with Lock( Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: ERROR keystone.server.flask.application Jun 22 08:52:54.926627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 662/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 22 08:52:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:52:54.931478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abd9c1-3346-412f-8aed-1070ff92757d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:55.005742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:55.027479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abd9c1-3346-412f-8aed-1070ff92757d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:55.059849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69bb8-5962-47c1-971a-5677ffe695e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:55.060495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69bb8-5962-47c1-971a-5677ffe695e6 None admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:55.060777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69bb8-5962-47c1-971a-5677ffe695e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:55.061050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69bb8-5962-47c1-971a-5677ffe695e6 None admin] PATH_INFO: `/v3/services` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:55.061744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69bb8-5962-47c1-971a-5677ffe695e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:52:55.062045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69bb8-5962-47c1-971a-5677ffe695e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:55.063423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69bb8-5962-47c1-971a-5677ffe695e6 None admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:55.068357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 643/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 22 08:52:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:52:55.074031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:55.175435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a58d2-aeb5-405c-9fc9-99818b13b0e8 None admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:55.208223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5acbf-a43e-4f69-aff8-18386cecfa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:55.208874 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5acbf-a43e-4f69-aff8-18386cecfa08 None admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:55.209164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5acbf-a43e-4f69-aff8-18386cecfa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:55.209445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5acbf-a43e-4f69-aff8-18386cecfa08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:55.210232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5acbf-a43e-4f69-aff8-18386cecfa08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:55.211618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5acbf-a43e-4f69-aff8-18386cecfa08 None admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:55.305195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 663/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 22 08:52:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:53:05.082809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=30 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:05.300798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:59.139643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f60c8-4d4b-4072-8918-ae1110757e2e None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:59.140113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f60c8-4d4b-4072-8918-ae1110757e2e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:59.140326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f60c8-4d4b-4072-8918-ae1110757e2e None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:59.147620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833b6b7-4f6c-4378-a2da-c1ec03e44a77 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:59.148023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833b6b7-4f6c-4378-a2da-c1ec03e44a77 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:59.148198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833b6b7-4f6c-4378-a2da-c1ec03e44a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:59.150344 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 644/1307] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:58:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:59.223576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6833b6b7-4f6c-4378-a2da-c1ec03e44a77 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:59.224796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6833b6b7-4f6c-4378-a2da-c1ec03e44a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:59.361153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 664/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:59.393692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d001ec-2146-4ba5-8b5b-8d8f673e4f9d None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:59.393977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d001ec-2146-4ba5-8b5b-8d8f673e4f9d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:59.394926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d001ec-2146-4ba5-8b5b-8d8f673e4f9d None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:59.399330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 645/1309] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jun 22 08:58:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:59.405517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e5980-68a9-4043-814a-48a211f97823 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:59.405736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e5980-68a9-4043-814a-48a211f97823 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:59.406029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e5980-68a9-4043-814a-48a211f97823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:59.509223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-821e5980-68a9-4043-814a-48a211f97823 None None] MFA Rules not processed for user `c6bbb0e4d7ca44fc8cb68fdc96260caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:59.510452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-821e5980-68a9-4043-814a-48a211f97823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:59.533322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:59.595290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 665/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jun 22 08:58:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:58:59.604244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d001ec-2146-4ba5-8b5b-8d8f673e4f9d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:59.606012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-17d001ec-2146-4ba5-8b5b-8d8f673e4f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:59.722837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d001ec-2146-4ba5-8b5b-8d8f673e4f9d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:59.799263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abff07-0745-453b-a11c-ee662c222b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:59.799931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abff07-0745-453b-a11c-ee662c222b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:59.800218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abff07-0745-453b-a11c-ee662c222b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:59.800498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abff07-0745-453b-a11c-ee662c222b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:59.802159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d1abff07-0745-453b-a11c-ee662c222b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:59.857460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:59.913418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abff07-0745-453b-a11c-ee662c222b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:59.914888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abff07-0745-453b-a11c-ee662c222b69 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:59.935004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 646/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:02.321532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b15c-451c-4969-b028-c4576ccd64a6 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:02.322045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b15c-451c-4969-b028-c4576ccd64a6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:02.322321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b15c-451c-4969-b028-c4576ccd64a6 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:02.323896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 666/1312] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:02.329816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1941fc-4a5f-4295-aa2b-78f455e67d7e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:02.330231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1941fc-4a5f-4295-aa2b-78f455e67d7e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:02.330426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1941fc-4a5f-4295-aa2b-78f455e67d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:02.421398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6b1941fc-4a5f-4295-aa2b-78f455e67d7e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:02.422890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6b1941fc-4a5f-4295-aa2b-78f455e67d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:02.525195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 647/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:02.564805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855b15c-451c-4969-b028-c4576ccd64a6 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:02.566534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e855b15c-451c-4969-b028-c4576ccd64a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:02.683023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855b15c-451c-4969-b028-c4576ccd64a6 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:02.761487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:02.764866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a65dd-692a-4432-af75-08b74c40b03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:02.765531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a65dd-692a-4432-af75-08b74c40b03f service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:02.765815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a65dd-692a-4432-af75-08b74c40b03f service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:02.766092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a65dd-692a-4432-af75-08b74c40b03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:02.767863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-622a65dd-692a-4432-af75-08b74c40b03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:02.885026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a65dd-692a-4432-af75-08b74c40b03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:02.886471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a65dd-692a-4432-af75-08b74c40b03f service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:02.905693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 667/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:05.492534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d26c9a-7767-4175-9bc4-147eca4e3691 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:05.493062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d26c9a-7767-4175-9bc4-147eca4e3691 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:05.493185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d26c9a-7767-4175-9bc4-147eca4e3691 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:05.494479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 648/1315] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:05.500036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dc57a-10b6-41d6-912a-fe94cb8aee7f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:05.500422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dc57a-10b6-41d6-912a-fe94cb8aee7f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:05.500568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dc57a-10b6-41d6-912a-fe94cb8aee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:05.562586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-793dc57a-10b6-41d6-912a-fe94cb8aee7f None None] MFA Rules not processed for user `874eba2718e1486988bc2175440805ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:05.563821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-793dc57a-10b6-41d6-912a-fe94cb8aee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:05.613674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:05.656830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 668/1316] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:05.696014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d26c9a-7767-4175-9bc4-147eca4e3691 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:05.697568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-22d26c9a-7767-4175-9bc4-147eca4e3691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:05.707308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:05.799650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d26c9a-7767-4175-9bc4-147eca4e3691 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:05.869872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f70c2d-7094-4a96-9e3b-633282debad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:05.870502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70c2d-7094-4a96-9e3b-633282debad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:05.870785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70c2d-7094-4a96-9e3b-633282debad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:05.871091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70c2d-7094-4a96-9e3b-633282debad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:05.872715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d5f70c2d-7094-4a96-9e3b-633282debad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:05.932397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:05.977185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f70c2d-7094-4a96-9e3b-633282debad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:05.978603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f70c2d-7094-4a96-9e3b-633282debad9 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:05.997283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 649/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:09.038564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57595d4d-7a26-4567-928c-4f4acc94a4f3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:09.039197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57595d4d-7a26-4567-928c-4f4acc94a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:09.039197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57595d4d-7a26-4567-928c-4f4acc94a4f3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:09.040509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 669/1318] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:59:09.045802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742443-6c1c-4c2d-8c5e-d916a15d84be None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:09.046271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742443-6c1c-4c2d-8c5e-d916a15d84be None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:09.046373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742443-6c1c-4c2d-8c5e-d916a15d84be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:09.112774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fc742443-6c1c-4c2d-8c5e-d916a15d84be None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:09.114208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fc742443-6c1c-4c2d-8c5e-d916a15d84be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:09.207415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 650/1319] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:09.247301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57595d4d-7a26-4567-928c-4f4acc94a4f3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:09.248871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-57595d4d-7a26-4567-928c-4f4acc94a4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:09.349296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57595d4d-7a26-4567-928c-4f4acc94a4f3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:09.421449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae12f83-f7c0-4d29-ab71-253c8a5f81b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:09.422097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae12f83-f7c0-4d29-ab71-253c8a5f81b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:09.422384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae12f83-f7c0-4d29-ab71-253c8a5f81b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:09.422660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae12f83-f7c0-4d29-ab71-253c8a5f81b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:09.424389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cae12f83-f7c0-4d29-ab71-253c8a5f81b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:09.431876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:09.533159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae12f83-f7c0-4d29-ab71-253c8a5f81b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:09.534589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae12f83-f7c0-4d29-ab71-253c8a5f81b0 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:09.552072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 670/1320] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:12.633226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2b1a-ac03-4d8f-8cbe-af2eca0a2f54 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:12.633746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2b1a-ac03-4d8f-8cbe-af2eca0a2f54 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:12.633746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2b1a-ac03-4d8f-8cbe-af2eca0a2f54 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:12.635086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 651/1321] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:12.640729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910397e-1ac4-435a-9624-015ba2d6b322 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:12.641159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910397e-1ac4-435a-9624-015ba2d6b322 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:12.641295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910397e-1ac4-435a-9624-015ba2d6b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:12.706836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9910397e-1ac4-435a-9624-015ba2d6b322 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:12.708068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9910397e-1ac4-435a-9624-015ba2d6b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:12.766365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:12.810564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 671/1322] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:12.847997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2b1a-ac03-4d8f-8cbe-af2eca0a2f54 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:12.849547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-91dd2b1a-ac03-4d8f-8cbe-af2eca0a2f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:12.869429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:12.958457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2b1a-ac03-4d8f-8cbe-af2eca0a2f54 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:13.032701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52eb0-a500-4b03-b6cb-904c5b9624db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:13.033345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52eb0-a500-4b03-b6cb-904c5b9624db service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:13.033626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52eb0-a500-4b03-b6cb-904c5b9624db service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:13.033898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52eb0-a500-4b03-b6cb-904c5b9624db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:13.035577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9ac52eb0-a500-4b03-b6cb-904c5b9624db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:13.105837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:13.145294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52eb0-a500-4b03-b6cb-904c5b9624db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:13.146732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52eb0-a500-4b03-b6cb-904c5b9624db service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:13.164385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 652/1323] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:15.251758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b99f-253c-4ba9-b75e-2a06dbb564fe None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:15.252292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b99f-253c-4ba9-b75e-2a06dbb564fe None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:15.252292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b99f-253c-4ba9-b75e-2a06dbb564fe None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:15.253579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 672/1324] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:15.258778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e019a4e-bfc9-4033-97f6-5f8d9b759f47 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:15.259206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e019a4e-bfc9-4033-97f6-5f8d9b759f47 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:15.263785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e019a4e-bfc9-4033-97f6-5f8d9b759f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:15.323576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-0e019a4e-bfc9-4033-97f6-5f8d9b759f47 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:15.324799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0e019a4e-bfc9-4033-97f6-5f8d9b759f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:15.423977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 653/1325] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:15.459820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1b99f-253c-4ba9-b75e-2a06dbb564fe None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:15.461392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-48b1b99f-253c-4ba9-b75e-2a06dbb564fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:15.568698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1b99f-253c-4ba9-b75e-2a06dbb564fe None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:15.643492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1de1f-4c76-4bda-9881-82b771558ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:15.644158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1de1f-4c76-4bda-9881-82b771558ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:15.644442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1de1f-4c76-4bda-9881-82b771558ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:15.644717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1de1f-4c76-4bda-9881-82b771558ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:15.646470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2dd1de1f-4c76-4bda-9881-82b771558ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:15.665338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:15.760864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1de1f-4c76-4bda-9881-82b771558ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:15.762314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1de1f-4c76-4bda-9881-82b771558ec9 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:15.781089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 673/1326] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:17.862149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c714f-4aaf-44c2-8c45-efe4f2744f2d None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:17.862681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c714f-4aaf-44c2-8c45-efe4f2744f2d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:17.862681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c714f-4aaf-44c2-8c45-efe4f2744f2d None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:17.864274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 654/1327] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:17.869133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651a16-7237-49de-8ee5-a45fb5ca2bd4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:17.869548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651a16-7237-49de-8ee5-a45fb5ca2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:17.869820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651a16-7237-49de-8ee5-a45fb5ca2bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:17.934411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-58651a16-7237-49de-8ee5-a45fb5ca2bd4 None None] MFA Rules not processed for user `874eba2718e1486988bc2175440805ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:17.935695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-58651a16-7237-49de-8ee5-a45fb5ca2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:18.001586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:18.034067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 674/1328] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:18.071261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c714f-4aaf-44c2-8c45-efe4f2744f2d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:18.072829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1c7c714f-4aaf-44c2-8c45-efe4f2744f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:18.113449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:18.192400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c714f-4aaf-44c2-8c45-efe4f2744f2d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:18.263838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcabde-f55e-4829-8f39-2fe1f15dca78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:18.265161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcabde-f55e-4829-8f39-2fe1f15dca78 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:18.265448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcabde-f55e-4829-8f39-2fe1f15dca78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:18.265728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcabde-f55e-4829-8f39-2fe1f15dca78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:18.267412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-70bcabde-f55e-4829-8f39-2fe1f15dca78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:18.344875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:18.377601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcabde-f55e-4829-8f39-2fe1f15dca78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:18.379080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcabde-f55e-4829-8f39-2fe1f15dca78 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:18.396558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 655/1329] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:20.931747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf79ea-20a0-480e-98ae-f184790bf524 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:20.932288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf79ea-20a0-480e-98ae-f184790bf524 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:20.932288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf79ea-20a0-480e-98ae-f184790bf524 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:20.933673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 675/1330] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:20.939417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea3c3b-65f3-40b3-b2a0-4879c5e51066 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:20.939796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea3c3b-65f3-40b3-b2a0-4879c5e51066 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:20.939975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea3c3b-65f3-40b3-b2a0-4879c5e51066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:21.004455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fbea3c3b-65f3-40b3-b2a0-4879c5e51066 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:21.005665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fbea3c3b-65f3-40b3-b2a0-4879c5e51066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:21.098450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 656/1331] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:21.134216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf79ea-20a0-480e-98ae-f184790bf524 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:21.135771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-aaaf79ea-20a0-480e-98ae-f184790bf524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:21.252512 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf79ea-20a0-480e-98ae-f184790bf524 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:21.326334 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaa2dd-9574-4e40-a306-2cdfc39d704d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:21.327071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa2dd-9574-4e40-a306-2cdfc39d704d service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:21.327359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa2dd-9574-4e40-a306-2cdfc39d704d service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:21.327635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa2dd-9574-4e40-a306-2cdfc39d704d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:21.329334 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5faaa2dd-9574-4e40-a306-2cdfc39d704d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:21.356670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:21.439760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaa2dd-9574-4e40-a306-2cdfc39d704d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:21.441209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaa2dd-9574-4e40-a306-2cdfc39d704d service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:21.459426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 676/1332] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:23.528923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b32b-f666-4d40-8da6-1724f53513fb None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:23.529520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b32b-f666-4d40-8da6-1724f53513fb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:23.529520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b32b-f666-4d40-8da6-1724f53513fb None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:23.531440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 657/1333] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:23.536444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057b29-9ae9-43d9-bb3d-b41592d9aad9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:23.536867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057b29-9ae9-43d9-bb3d-b41592d9aad9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:23.537007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057b29-9ae9-43d9-bb3d-b41592d9aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:23.599233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f2057b29-9ae9-43d9-bb3d-b41592d9aad9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:23.600445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f2057b29-9ae9-43d9-bb3d-b41592d9aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:23.674088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:23.696564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 677/1334] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:23.736773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b32b-f666-4d40-8da6-1724f53513fb None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:23.738306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a7a8b32b-f666-4d40-8da6-1724f53513fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:23.779395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:23.841312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b32b-f666-4d40-8da6-1724f53513fb None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:23.912447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d0b5-acb2-4bff-a9c5-33990305d9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:23.913083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d0b5-acb2-4bff-a9c5-33990305d9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:23.913369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d0b5-acb2-4bff-a9c5-33990305d9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:23.913646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d0b5-acb2-4bff-a9c5-33990305d9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:23.915299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-45c0d0b5-acb2-4bff-a9c5-33990305d9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:23.996260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:24.021047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d0b5-acb2-4bff-a9c5-33990305d9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:24.022451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d0b5-acb2-4bff-a9c5-33990305d9dc service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:24.040012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 658/1335] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:26.730072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02db11-ae9e-4946-9acd-04e5b19ae826 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:26.730606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02db11-ae9e-4946-9acd-04e5b19ae826 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:26.730606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02db11-ae9e-4946-9acd-04e5b19ae826 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:26.732038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 678/1336] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:26.737963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a8dce-3753-4301-9aeb-a2b4911b8725 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:26.738426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a8dce-3753-4301-9aeb-a2b4911b8725 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:26.738523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a8dce-3753-4301-9aeb-a2b4911b8725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:26.801977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a79a8dce-3753-4301-9aeb-a2b4911b8725 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:26.803211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a79a8dce-3753-4301-9aeb-a2b4911b8725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:26.896085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 659/1337] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:26.946928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefac21-cd03-4d32-a0cd-f52789186435 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:26.947217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefac21-cd03-4d32-a0cd-f52789186435 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:26.947481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefac21-cd03-4d32-a0cd-f52789186435 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:26.948861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 679/1338] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jun 22 08:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:26.954570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20e15-3f87-4b73-8eb7-2ecdaa8d65ef None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:26.954897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20e15-3f87-4b73-8eb7-2ecdaa8d65ef None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:26.955188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20e15-3f87-4b73-8eb7-2ecdaa8d65ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:27.007704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:27.030652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-47a20e15-3f87-4b73-8eb7-2ecdaa8d65ef None None] MFA Rules not processed for user `c6bbb0e4d7ca44fc8cb68fdc96260caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:27.031921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-47a20e15-3f87-4b73-8eb7-2ecdaa8d65ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:27.106036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 660/1339] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jun 22 08:59:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:27.115166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefac21-cd03-4d32-a0cd-f52789186435 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:27.116712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fcefac21-cd03-4d32-a0cd-f52789186435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:27.224607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefac21-cd03-4d32-a0cd-f52789186435 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:27.297186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c0f70-453c-47cd-b0bd-44aacbf367df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:27.297769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c0f70-453c-47cd-b0bd-44aacbf367df service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:27.298057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c0f70-453c-47cd-b0bd-44aacbf367df service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:27.298339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c0f70-453c-47cd-b0bd-44aacbf367df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:27.300127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f68c0f70-453c-47cd-b0bd-44aacbf367df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:27.335358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:27.408803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c0f70-453c-47cd-b0bd-44aacbf367df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:27.410238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c0f70-453c-47cd-b0bd-44aacbf367df service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:27.428260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 680/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:32.159644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79bd24-2027-4cd8-9235-a920bba56d6f None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:32.160541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79bd24-2027-4cd8-9235-a920bba56d6f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:32.160831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79bd24-2027-4cd8-9235-a920bba56d6f None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:32.162261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 661/1341] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:32.168293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70bf4-33bc-4ffe-99e0-cb8f23235bc4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:32.168806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70bf4-33bc-4ffe-99e0-cb8f23235bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:32.168928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70bf4-33bc-4ffe-99e0-cb8f23235bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:32.249127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-16e70bf4-33bc-4ffe-99e0-cb8f23235bc4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:32.250337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-16e70bf4-33bc-4ffe-99e0-cb8f23235bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:32.353894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:32.368157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 681/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:32.406922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79bd24-2027-4cd8-9235-a920bba56d6f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:32.409205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3f79bd24-2027-4cd8-9235-a920bba56d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:32.513588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79bd24-2027-4cd8-9235-a920bba56d6f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:32.517226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7242ad6-6198-46fa-ba5c-68dcf1451c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:32.517877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7242ad6-6198-46fa-ba5c-68dcf1451c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:32.518270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7242ad6-6198-46fa-ba5c-68dcf1451c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:32.518555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7242ad6-6198-46fa-ba5c-68dcf1451c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:32.527554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7242ad6-6198-46fa-ba5c-68dcf1451c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:32.529084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7242ad6-6198-46fa-ba5c-68dcf1451c36 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:32.538538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 662/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:35.580228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a7e2-c706-4831-a8e4-0e0262c7d346 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:35.580818 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a7e2-c706-4831-a8e4-0e0262c7d346 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:35.580818 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a7e2-c706-4831-a8e4-0e0262c7d346 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:35.582168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 682/1344] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:35.588099 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec724f8-93a7-4378-899b-8c672f285a72 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:35.588613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec724f8-93a7-4378-899b-8c672f285a72 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:35.588722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec724f8-93a7-4378-899b-8c672f285a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:35.618239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-4ec724f8-93a7-4378-899b-8c672f285a72 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:35.619533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4ec724f8-93a7-4378-899b-8c672f285a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:35.650326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:35.701503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 663/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:35.740144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70a7e2-c706-4831-a8e4-0e0262c7d346 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:35.750600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70a7e2-c706-4831-a8e4-0e0262c7d346 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:35.754066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa61074-73af-4b2a-963d-4538af82ec6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:35.754702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa61074-73af-4b2a-963d-4538af82ec6a service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:35.755023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa61074-73af-4b2a-963d-4538af82ec6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:35.755306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa61074-73af-4b2a-963d-4538af82ec6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:35.764259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa61074-73af-4b2a-963d-4538af82ec6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:35.765696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa61074-73af-4b2a-963d-4538af82ec6a service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:35.775026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 683/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:39.970662 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8f28-141b-4c0a-bc15-49cbe88419f5 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:39.971256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8f28-141b-4c0a-bc15-49cbe88419f5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:39.971353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8f28-141b-4c0a-bc15-49cbe88419f5 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:39.972672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 664/1347] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:59:39.978052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db1e66-fe47-4979-a9c7-9938a908f06b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:39.978484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db1e66-fe47-4979-a9c7-9938a908f06b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:39.978624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db1e66-fe47-4979-a9c7-9938a908f06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:39.998890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b5db1e66-fe47-4979-a9c7-9938a908f06b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:40.000165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b5db1e66-fe47-4979-a9c7-9938a908f06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:40.008700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 684/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:40.047439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de8f28-141b-4c0a-bc15-49cbe88419f5 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:40.058357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de8f28-141b-4c0a-bc15-49cbe88419f5 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:40.062535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389343-4a8d-4037-81e1-ff225efc58c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:40.063247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389343-4a8d-4037-81e1-ff225efc58c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:40.067115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389343-4a8d-4037-81e1-ff225efc58c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:40.067115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389343-4a8d-4037-81e1-ff225efc58c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:40.073013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389343-4a8d-4037-81e1-ff225efc58c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:40.074515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389343-4a8d-4037-81e1-ff225efc58c1 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:40.084184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 665/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:45.037716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f6cf-f7a0-4363-980c-e3f16aa22e2b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:45.038242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f6cf-f7a0-4363-980c-e3f16aa22e2b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:45.038242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f6cf-f7a0-4363-980c-e3f16aa22e2b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:45.039635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 685/1350] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 08:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:45.045639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405313e7-84b0-47fb-bb97-737772ec1e5a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:45.046040 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405313e7-84b0-47fb-bb97-737772ec1e5a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:45.046327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405313e7-84b0-47fb-bb97-737772ec1e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:45.118569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-405313e7-84b0-47fb-bb97-737772ec1e5a None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:45.120309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-405313e7-84b0-47fb-bb97-737772ec1e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:45.204432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 666/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 08:59:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:49.495073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d9a5-98c0-4dbe-9844-06766f5b6e75 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:49.495614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d9a5-98c0-4dbe-9844-06766f5b6e75 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:49.495876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d9a5-98c0-4dbe-9844-06766f5b6e75 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:49.498246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 686/1352] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 08:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:49.503549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d535-9cd8-46b2-947a-a30f2328f9ba None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:49.503970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d535-9cd8-46b2-947a-a30f2328f9ba None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:49.504298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d535-9cd8-46b2-947a-a30f2328f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:49.523581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-aa77d535-9cd8-46b2-947a-a30f2328f9ba None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:49.525116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-aa77d535-9cd8-46b2-947a-a30f2328f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:49.534325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 667/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 08:59:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:50.003750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=13 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:50.824228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6854b6-bef0-4fda-95a8-fc9382bb0a10 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:50.824858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6854b6-bef0-4fda-95a8-fc9382bb0a10 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:50.824858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6854b6-bef0-4fda-95a8-fc9382bb0a10 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:50.829180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 687/1354] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 08:59:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:50.832024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f3e6-fe23-4962-a2e9-6db7769dce88 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:50.838355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f3e6-fe23-4962-a2e9-6db7769dce88 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:50.838355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f3e6-fe23-4962-a2e9-6db7769dce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:50.851329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-63f3f3e6-fe23-4962-a2e9-6db7769dce88 None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:50.852632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-63f3f3e6-fe23-4962-a2e9-6db7769dce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:50.861957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 668/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 08:59:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:54.658054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264910a-63ff-44fa-b847-45971aebdc39 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:54.658586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264910a-63ff-44fa-b847-45971aebdc39 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:54.658586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264910a-63ff-44fa-b847-45971aebdc39 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:54.659887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 688/1356] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:54.665265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd3f3-7a89-4d4c-9af1-0abeaf05950b None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:54.665700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd3f3-7a89-4d4c-9af1-0abeaf05950b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:54.665836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fd3f3-7a89-4d4c-9af1-0abeaf05950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:54.684632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-536fd3f3-7a89-4d4c-9af1-0abeaf05950b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:54.685811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-536fd3f3-7a89-4d4c-9af1-0abeaf05950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:54.693954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 669/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:54.750983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129895b8-fa47-4222-bda1-e28c43595a5a None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:54.751648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129895b8-fa47-4222-bda1-e28c43595a5a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:54.752244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129895b8-fa47-4222-bda1-e28c43595a5a None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:54.753882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 689/1358] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 22 08:59:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:54.762430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c008d-c68f-478c-a8b4-df79bae094d8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:54.763474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c008d-c68f-478c-a8b4-df79bae094d8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:54.771171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c008d-c68f-478c-a8b4-df79bae094d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:54.810454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:54.823280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c65c008d-c68f-478c-a8b4-df79bae094d8 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:54.824720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c65c008d-c68f-478c-a8b4-df79bae094d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:54.914941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 670/1359] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 22 08:59:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:54.923105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129895b8-fa47-4222-bda1-e28c43595a5a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:54.937908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129895b8-fa47-4222-bda1-e28c43595a5a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:54.943578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f3f4-5bfe-4c6c-91a2-930c877f7384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:54.944318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f3f4-5bfe-4c6c-91a2-930c877f7384 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:54.944677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f3f4-5bfe-4c6c-91a2-930c877f7384 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:54.945051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f3f4-5bfe-4c6c-91a2-930c877f7384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:54.954399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f3f4-5bfe-4c6c-91a2-930c877f7384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:54.956143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f3f4-5bfe-4c6c-91a2-930c877f7384 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:54.966884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 690/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:57.217247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566045f-9c41-49e6-acee-ab977b37566e None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:57.217773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566045f-9c41-49e6-acee-ab977b37566e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:57.217888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566045f-9c41-49e6-acee-ab977b37566e None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:57.219197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 671/1361] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:57.224568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f4a84-afe4-472d-b5d1-974e5e052296 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:57.225001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f4a84-afe4-472d-b5d1-974e5e052296 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:57.225130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f4a84-afe4-472d-b5d1-974e5e052296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:57.244225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-113f4a84-afe4-472d-b5d1-974e5e052296 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:57.245714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-113f4a84-afe4-472d-b5d1-974e5e052296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:57.254413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 691/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:57.298091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566045f-9c41-49e6-acee-ab977b37566e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:57.312998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566045f-9c41-49e6-acee-ab977b37566e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:57.318405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b47d1-a041-4d1b-8519-9714d0a11ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:57.319078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b47d1-a041-4d1b-8519-9714d0a11ac4 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:57.319366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b47d1-a041-4d1b-8519-9714d0a11ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:57.319645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b47d1-a041-4d1b-8519-9714d0a11ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:57.328165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b47d1-a041-4d1b-8519-9714d0a11ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:57.329768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b47d1-a041-4d1b-8519-9714d0a11ac4 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:57.339589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 672/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:59.791172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d180-f0ae-40ae-b5c0-6bf56537a377 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:59.791675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d180-f0ae-40ae-b5c0-6bf56537a377 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:59.791675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d180-f0ae-40ae-b5c0-6bf56537a377 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:59.792993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 692/1364] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 08:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:59.798753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73a8d-0a1c-416f-9233-3f7790194650 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:59.799195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73a8d-0a1c-416f-9233-3f7790194650 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:59.799412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73a8d-0a1c-416f-9233-3f7790194650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:59.822120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-efa73a8d-0a1c-416f-9233-3f7790194650 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:59.823429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-efa73a8d-0a1c-416f-9233-3f7790194650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:59.831295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 673/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 08:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:59.878397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b22c9-ca0c-49b2-8f99-a4265e464a69 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:59.878683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b22c9-ca0c-49b2-8f99-a4265e464a69 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:59.880115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b22c9-ca0c-49b2-8f99-a4265e464a69 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:59.880482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 693/1366] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 22 08:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:59:59.885799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4530a-777c-41c1-a9d4-44f1a36788b0 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:59.886095 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4530a-777c-41c1-a9d4-44f1a36788b0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:59.886378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4530a-777c-41c1-a9d4-44f1a36788b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:59.905036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2cf4530a-777c-41c1-a9d4-44f1a36788b0 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:59:59.906234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2cf4530a-777c-41c1-a9d4-44f1a36788b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:59:59.915815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 674/1367] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 22 08:59:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:59:59.923964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b22c9-ca0c-49b2-8f99-a4265e464a69 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:59:59.937888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b22c9-ca0c-49b2-8f99-a4265e464a69 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:59:59.943194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aaf78-2d38-42a8-8263-926b4dfbbb08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:59:59.943817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaf78-2d38-42a8-8263-926b4dfbbb08 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:59:59.944098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaf78-2d38-42a8-8263-926b4dfbbb08 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:59:59.944367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaf78-2d38-42a8-8263-926b4dfbbb08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:59:59.952339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aaf78-2d38-42a8-8263-926b4dfbbb08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:59:59.953906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aaf78-2d38-42a8-8263-926b4dfbbb08 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:59:59.963140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 694/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 08:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:02.225312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c556d6-beff-41a5-b11c-69bc11b58ed9 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:02.225890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c556d6-beff-41a5-b11c-69bc11b58ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:02.226127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c556d6-beff-41a5-b11c-69bc11b58ed9 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:02.227772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 675/1369] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:02.233841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9715f9-c456-4ae1-8359-20bbfd435a9a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:02.234508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9715f9-c456-4ae1-8359-20bbfd435a9a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:02.234654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9715f9-c456-4ae1-8359-20bbfd435a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:02.253789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0d9715f9-c456-4ae1-8359-20bbfd435a9a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:02.255041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0d9715f9-c456-4ae1-8359-20bbfd435a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:02.263267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 695/1370] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:02.308619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c556d6-beff-41a5-b11c-69bc11b58ed9 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:02.324074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c556d6-beff-41a5-b11c-69bc11b58ed9 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:02.329709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63764b-0687-4850-9ee7-0f4c54d42e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:02.330435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63764b-0687-4850-9ee7-0f4c54d42e34 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:02.330789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63764b-0687-4850-9ee7-0f4c54d42e34 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:02.331181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63764b-0687-4850-9ee7-0f4c54d42e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:02.339767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63764b-0687-4850-9ee7-0f4c54d42e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:02.341339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63764b-0687-4850-9ee7-0f4c54d42e34 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:02.354229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 676/1371] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:02.749348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25887-b661-459c-8907-c0e5b5aef320 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:02.749919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25887-b661-459c-8907-c0e5b5aef320 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:02.750350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25887-b661-459c-8907-c0e5b5aef320 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:02.751909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 696/1372] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:02.757234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdddb08-90c6-405f-922e-49fd396f0bb5 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:02.757587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdddb08-90c6-405f-922e-49fd396f0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:02.757938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdddb08-90c6-405f-922e-49fd396f0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:02.776880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-bcdddb08-90c6-405f-922e-49fd396f0bb5 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:02.778629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bcdddb08-90c6-405f-922e-49fd396f0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:02.787527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 677/1373] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:03.135949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470dd31-2966-43a3-b780-89586d2e6177 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:03.136311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470dd31-2966-43a3-b780-89586d2e6177 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:03.136671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470dd31-2966-43a3-b780-89586d2e6177 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:03.138625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 697/1374] 10.222.0.55 () {54 vars in 963 bytes} [Wed Jun 22 09:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:03.143698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b745-672b-4855-bcf4-ce94c633436d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:03.143993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b745-672b-4855-bcf4-ce94c633436d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:03.144277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b745-672b-4855-bcf4-ce94c633436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:03.195608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-0da7b745-672b-4855-bcf4-ce94c633436d None None] MFA Rules not processed for user `497a2c9e3fe04d9e85d513c9beb4f6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:03.196832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0da7b745-672b-4855-bcf4-ce94c633436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:03.262815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 678/1375] 10.222.0.55 () {58 vars in 1060 bytes} [Wed Jun 22 09:00:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:03.270057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470dd31-2966-43a3-b780-89586d2e6177 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:03.282011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470dd31-2966-43a3-b780-89586d2e6177 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:03.285642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e47d-da20-45fd-9a67-f5ef80c775e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:03.286285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e47d-da20-45fd-9a67-f5ef80c775e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:03.286573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e47d-da20-45fd-9a67-f5ef80c775e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:03.286873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e47d-da20-45fd-9a67-f5ef80c775e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:03.296472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e47d-da20-45fd-9a67-f5ef80c775e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:03.297911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e47d-da20-45fd-9a67-f5ef80c775e2 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:03.307814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 698/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:04.564955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf940a-4ae8-4ffc-add5-ec4466cc1741 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:04.565500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf940a-4ae8-4ffc-add5-ec4466cc1741 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:04.565656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf940a-4ae8-4ffc-add5-ec4466cc1741 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:04.566963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 679/1377] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:04.572270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afa488-a819-4c2e-967d-a4f25e74051b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:04.572693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afa488-a819-4c2e-967d-a4f25e74051b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:04.573048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afa488-a819-4c2e-967d-a4f25e74051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:04.590476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c6afa488-a819-4c2e-967d-a4f25e74051b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:04.591786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c6afa488-a819-4c2e-967d-a4f25e74051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:04.599727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 699/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:04.643962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf940a-4ae8-4ffc-add5-ec4466cc1741 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:04.657908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf940a-4ae8-4ffc-add5-ec4466cc1741 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:04.663223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e955c-9577-46f5-9a24-17f5b1aff90c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:04.664065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e955c-9577-46f5-9a24-17f5b1aff90c service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:04.664351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e955c-9577-46f5-9a24-17f5b1aff90c service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:04.664630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e955c-9577-46f5-9a24-17f5b1aff90c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:04.673209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e955c-9577-46f5-9a24-17f5b1aff90c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:04.674788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e955c-9577-46f5-9a24-17f5b1aff90c service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:04.678627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:04.685078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 680/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:06.893296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839825e6-4264-4bd5-9c20-4eaf15808dcc None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:06.894144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839825e6-4264-4bd5-9c20-4eaf15808dcc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:06.894581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839825e6-4264-4bd5-9c20-4eaf15808dcc None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:06.896009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 700/1380] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:06.901640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b1539-aac0-498d-b9c3-19dbd3ea98cc None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:06.902420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b1539-aac0-498d-b9c3-19dbd3ea98cc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:06.903471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b1539-aac0-498d-b9c3-19dbd3ea98cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:06.924749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9e7b1539-aac0-498d-b9c3-19dbd3ea98cc None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:06.926224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9e7b1539-aac0-498d-b9c3-19dbd3ea98cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:06.936718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 681/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:06.984103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839825e6-4264-4bd5-9c20-4eaf15808dcc None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:07.008014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839825e6-4264-4bd5-9c20-4eaf15808dcc None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:07.016574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc3663-b5f0-4f0c-9199-c68500397e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:07.017512 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3663-b5f0-4f0c-9199-c68500397e16 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:07.017959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3663-b5f0-4f0c-9199-c68500397e16 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:07.018400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3663-b5f0-4f0c-9199-c68500397e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:07.031710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc3663-b5f0-4f0c-9199-c68500397e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:07.033581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc3663-b5f0-4f0c-9199-c68500397e16 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:07.044859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 701/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:09.235871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735f63-aa01-4aad-8a50-4ec8b0c55f6e None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:09.236394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735f63-aa01-4aad-8a50-4ec8b0c55f6e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:09.236394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735f63-aa01-4aad-8a50-4ec8b0c55f6e None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:09.237762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 682/1383] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:09.242878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b2d0-9ad8-49e2-a32c-439f4bae2597 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:09.243308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b2d0-9ad8-49e2-a32c-439f4bae2597 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:09.243434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b2d0-9ad8-49e2-a32c-439f4bae2597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:09.261373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-1f93b2d0-9ad8-49e2-a32c-439f4bae2597 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:09.263139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1f93b2d0-9ad8-49e2-a32c-439f4bae2597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:09.270797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 702/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:09.312459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735f63-aa01-4aad-8a50-4ec8b0c55f6e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:09.330265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735f63-aa01-4aad-8a50-4ec8b0c55f6e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:09.337200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d472-2fb9-4069-9add-01d96537f6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:09.338137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d472-2fb9-4069-9add-01d96537f6be service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:09.338495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d472-2fb9-4069-9add-01d96537f6be service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:09.338848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d472-2fb9-4069-9add-01d96537f6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:09.348896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d472-2fb9-4069-9add-01d96537f6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:09.351088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d472-2fb9-4069-9add-01d96537f6be service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:09.363330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 683/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:11.414636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7feeda-1066-4df5-8133-44dd843c716f None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:11.415234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7feeda-1066-4df5-8133-44dd843c716f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:11.415419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7feeda-1066-4df5-8133-44dd843c716f None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:11.417271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 703/1386] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:11.423775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82faa-7175-4612-addf-d61e67829ff1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:11.424298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82faa-7175-4612-addf-d61e67829ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:11.424529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82faa-7175-4612-addf-d61e67829ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:11.447323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b9a82faa-7175-4612-addf-d61e67829ff1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:11.449190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b9a82faa-7175-4612-addf-d61e67829ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:11.460184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 684/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:11.521531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7feeda-1066-4df5-8133-44dd843c716f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:11.537087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7feeda-1066-4df5-8133-44dd843c716f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:11.542562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26ed72-de58-4b6b-adba-8cf2189f9201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:11.543782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26ed72-de58-4b6b-adba-8cf2189f9201 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:11.544047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26ed72-de58-4b6b-adba-8cf2189f9201 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:11.544327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26ed72-de58-4b6b-adba-8cf2189f9201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:11.552876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26ed72-de58-4b6b-adba-8cf2189f9201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:11.554461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26ed72-de58-4b6b-adba-8cf2189f9201 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:11.564753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 704/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:14.127445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a32c-7ad5-4373-8214-996540ac6ee5 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:14.127996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a32c-7ad5-4373-8214-996540ac6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:14.127996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a32c-7ad5-4373-8214-996540ac6ee5 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:14.129366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 685/1389] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:14.135602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3760-1186-4972-9820-eb9cd132586a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:14.136033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3760-1186-4972-9820-eb9cd132586a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:14.136262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3760-1186-4972-9820-eb9cd132586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:14.157024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-462c3760-1186-4972-9820-eb9cd132586a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:14.158471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-462c3760-1186-4972-9820-eb9cd132586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:14.167690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 705/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:14.212336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a32c-7ad5-4373-8214-996540ac6ee5 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:14.226922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a32c-7ad5-4373-8214-996540ac6ee5 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:14.232845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b176ff1-d3d6-4167-b197-bb1c52cf7873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:14.233490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b176ff1-d3d6-4167-b197-bb1c52cf7873 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:14.233777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b176ff1-d3d6-4167-b197-bb1c52cf7873 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:14.234323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b176ff1-d3d6-4167-b197-bb1c52cf7873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:14.242782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b176ff1-d3d6-4167-b197-bb1c52cf7873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:14.244432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b176ff1-d3d6-4167-b197-bb1c52cf7873 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:14.254716 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 686/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:16.870835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e113d-41de-4740-9f90-2cd759690695 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:16.871926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e113d-41de-4740-9f90-2cd759690695 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:16.871926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e113d-41de-4740-9f90-2cd759690695 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:16.873312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 706/1392] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:00:16.878507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf65dac-896b-4d43-b326-b974e3e975d8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:16.878925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf65dac-896b-4d43-b326-b974e3e975d8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:16.879128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf65dac-896b-4d43-b326-b974e3e975d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:16.897321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-bdf65dac-896b-4d43-b326-b974e3e975d8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:16.898529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bdf65dac-896b-4d43-b326-b974e3e975d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:16.906407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 687/1393] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:16.950963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e113d-41de-4740-9f90-2cd759690695 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:16.965118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e113d-41de-4740-9f90-2cd759690695 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:16.970461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3393814-2384-4ad9-b8af-2d27ea646355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:16.971134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393814-2384-4ad9-b8af-2d27ea646355 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:16.971425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393814-2384-4ad9-b8af-2d27ea646355 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:16.971707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393814-2384-4ad9-b8af-2d27ea646355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:16.980040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3393814-2384-4ad9-b8af-2d27ea646355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:16.981607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3393814-2384-4ad9-b8af-2d27ea646355 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:16.991380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 707/1394] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:18.707582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1cd43-0285-41ec-b02e-ad38d83ba045 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:18.708332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1cd43-0285-41ec-b02e-ad38d83ba045 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:18.708332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1cd43-0285-41ec-b02e-ad38d83ba045 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:18.710002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 688/1395] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:18.715553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be82ab7-ec99-410f-8fc8-e0d2830e4c9b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:18.716031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be82ab7-ec99-410f-8fc8-e0d2830e4c9b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:18.716318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be82ab7-ec99-410f-8fc8-e0d2830e4c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:18.735841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0be82ab7-ec99-410f-8fc8-e0d2830e4c9b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:18.737090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0be82ab7-ec99-410f-8fc8-e0d2830e4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:18.745878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 708/1396] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:18.804128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb7a6-4c67-42bd-80d3-b4e364d6f1f4 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:18.804427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb7a6-4c67-42bd-80d3-b4e364d6f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:18.804714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb7a6-4c67-42bd-80d3-b4e364d6f1f4 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:18.806067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 689/1397] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jun 22 09:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:18.811796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36cb9-6497-4d0a-91db-3770916ac5f3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:18.812172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36cb9-6497-4d0a-91db-3770916ac5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:18.812571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36cb9-6497-4d0a-91db-3770916ac5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:18.860272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4be36cb9-6497-4d0a-91db-3770916ac5f3 None None] MFA Rules not processed for user `99a49aca72844411b6bc1feff566cc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:18.861475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4be36cb9-6497-4d0a-91db-3770916ac5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:18.922050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 709/1398] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jun 22 09:00:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:18.929591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb7a6-4c67-42bd-80d3-b4e364d6f1f4 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:18.941085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb7a6-4c67-42bd-80d3-b4e364d6f1f4 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:18.944742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b5b38-f340-49cc-9bfe-37a847208eb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:18.945388 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b5b38-f340-49cc-9bfe-37a847208eb3 service glance] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:18.945785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b5b38-f340-49cc-9bfe-37a847208eb3 service glance] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:18.946074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b5b38-f340-49cc-9bfe-37a847208eb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:18.955293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b5b38-f340-49cc-9bfe-37a847208eb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:18.956752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b5b38-f340-49cc-9bfe-37a847208eb3 service glance] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:18.967120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 690/1399] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:19.295561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988155cd-07b1-41f8-acd7-77027267e0db None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:19.295781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988155cd-07b1-41f8-acd7-77027267e0db None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:19.296070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988155cd-07b1-41f8-acd7-77027267e0db None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:19.297445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 710/1400] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:19.302643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1307-df66-45f8-9563-792415f6eb42 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:19.302981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1307-df66-45f8-9563-792415f6eb42 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:19.303270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1307-df66-45f8-9563-792415f6eb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:19.321868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-da0f1307-df66-45f8-9563-792415f6eb42 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:19.323668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-da0f1307-df66-45f8-9563-792415f6eb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:19.331013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 691/1401] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:19.375225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988155cd-07b1-41f8-acd7-77027267e0db None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:19.390683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988155cd-07b1-41f8-acd7-77027267e0db None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:19.396743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca340a48-9cfb-46e8-a40a-cf6a57202652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:19.397424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340a48-9cfb-46e8-a40a-cf6a57202652 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:19.397680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340a48-9cfb-46e8-a40a-cf6a57202652 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:19.397967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340a48-9cfb-46e8-a40a-cf6a57202652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:19.409847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca340a48-9cfb-46e8-a40a-cf6a57202652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:19.411590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca340a48-9cfb-46e8-a40a-cf6a57202652 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:19.422051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 711/1402] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:19.870449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516a4f-f74c-45cc-aa07-ecc669d09364 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:19.872154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516a4f-f74c-45cc-aa07-ecc669d09364 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:19.872154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516a4f-f74c-45cc-aa07-ecc669d09364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:19.919719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-dd516a4f-f74c-45cc-aa07-ecc669d09364 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:19.920931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-dd516a4f-f74c-45cc-aa07-ecc669d09364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:19.984911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 692/1403] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:00:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:20.026178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b719111-3d30-4e58-a27c-d779038ea46e None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:20.026650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b719111-3d30-4e58-a27c-d779038ea46e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:20.026930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b719111-3d30-4e58-a27c-d779038ea46e None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:20.028404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 712/1404] 10.222.0.55 () {54 vars in 942 bytes} [Wed Jun 22 09:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:20.034958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243848-1710-47e8-9b7d-19ecbb5ebad4 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:20.035257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243848-1710-47e8-9b7d-19ecbb5ebad4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:20.035541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243848-1710-47e8-9b7d-19ecbb5ebad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:20.084281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-34243848-1710-47e8-9b7d-19ecbb5ebad4 None None] MFA Rules not processed for user `0a839b5b74e44b428f5989dd48cb1f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:20.085497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-34243848-1710-47e8-9b7d-19ecbb5ebad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:20.120630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:20.160043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 693/1405] 10.222.0.55 () {58 vars in 1039 bytes} [Wed Jun 22 09:00:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:20.171746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b719111-3d30-4e58-a27c-d779038ea46e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:20.179142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:20.186165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b719111-3d30-4e58-a27c-d779038ea46e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:20.191881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e05e-f42c-43ed-9331-3ae7b7572d27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:20.192536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e05e-f42c-43ed-9331-3ae7b7572d27 service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:20.192832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e05e-f42c-43ed-9331-3ae7b7572d27 service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:20.193115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e05e-f42c-43ed-9331-3ae7b7572d27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:20.203170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150e05e-f42c-43ed-9331-3ae7b7572d27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:20.204774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150e05e-f42c-43ed-9331-3ae7b7572d27 service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:20.213070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 713/1406] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:00:21.662473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770834a-439e-42fb-a1be-dba7a4ee4311 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:21.662473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770834a-439e-42fb-a1be-dba7a4ee4311 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:21.662473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770834a-439e-42fb-a1be-dba7a4ee4311 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:21.662473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 694/1407] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:00:21.665975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035153-c042-4d1c-b9f9-1beacbb73dc7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:21.666372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035153-c042-4d1c-b9f9-1beacbb73dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:21.666521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035153-c042-4d1c-b9f9-1beacbb73dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:21.686504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6c035153-c042-4d1c-b9f9-1beacbb73dc7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:21.687731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6c035153-c042-4d1c-b9f9-1beacbb73dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:21.700801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 714/1408] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:21.747596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770834a-439e-42fb-a1be-dba7a4ee4311 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:21.766687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770834a-439e-42fb-a1be-dba7a4ee4311 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:21.772715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510a86b-7c79-49d9-8ef2-2240ce4240d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:21.773584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a86b-7c79-49d9-8ef2-2240ce4240d4 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:21.773994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a86b-7c79-49d9-8ef2-2240ce4240d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:21.774384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a86b-7c79-49d9-8ef2-2240ce4240d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:21.783827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510a86b-7c79-49d9-8ef2-2240ce4240d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:21.785508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510a86b-7c79-49d9-8ef2-2240ce4240d4 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:21.799790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 695/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:31.681032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=8 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:31.791737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=21 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:43.518613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7349-323b-47da-b43a-212b144a819f None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.519191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7349-323b-47da-b43a-212b144a819f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.519191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7349-323b-47da-b43a-212b144a819f None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.520495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 715/1410] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jun 22 09:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:43.525599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e0d0-de72-4214-9454-50e3ba87086c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.526025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e0d0-de72-4214-9454-50e3ba87086c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.526162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360e0d0-de72-4214-9454-50e3ba87086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.544735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6360e0d0-de72-4214-9454-50e3ba87086c None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:43.545946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6360e0d0-de72-4214-9454-50e3ba87086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:43.554460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 696/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 22 09:00:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:43.568683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e445e7-e5ef-4778-ad6c-0a244a19b45b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.568977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e445e7-e5ef-4778-ad6c-0a244a19b45b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.569260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e445e7-e5ef-4778-ad6c-0a244a19b45b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.570611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 716/1412] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jun 22 09:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:43.575763 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4fd3e-e5fb-416e-bf25-b861ddd516ad None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.576057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4fd3e-e5fb-416e-bf25-b861ddd516ad None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.576338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4fd3e-e5fb-416e-bf25-b861ddd516ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.595194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-4ef4fd3e-e5fb-416e-bf25-b861ddd516ad None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:43.596384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4ef4fd3e-e5fb-416e-bf25-b861ddd516ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:43.605425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 697/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 22 09:00:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:46.098667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73c47a-f588-4a9d-99f8-c6b32432eb5d None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.099167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73c47a-f588-4a9d-99f8-c6b32432eb5d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.099274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73c47a-f588-4a9d-99f8-c6b32432eb5d None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.100748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:46.106418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df36eba-3179-4f71-b3f2-6397c17e7aff None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.106852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df36eba-3179-4f71-b3f2-6397c17e7aff None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.107002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df36eba-3179-4f71-b3f2-6397c17e7aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.124638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3df36eba-3179-4f71-b3f2-6397c17e7aff None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:46.125828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3df36eba-3179-4f71-b3f2-6397c17e7aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:46.133505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:46.176803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73c47a-f588-4a9d-99f8-c6b32432eb5d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:46.191158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73c47a-f588-4a9d-99f8-c6b32432eb5d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:46.196580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999bc46-8d59-43ed-8d25-2fd8bf890753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:46.197207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bc46-8d59-43ed-8d25-2fd8bf890753 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.197489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bc46-8d59-43ed-8d25-2fd8bf890753 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.197765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bc46-8d59-43ed-8d25-2fd8bf890753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.205768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999bc46-8d59-43ed-8d25-2fd8bf890753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:46.207363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999bc46-8d59-43ed-8d25-2fd8bf890753 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:46.217406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 718/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:47.109408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332274b2-4d75-4e31-8370-8dbaf7198e1d None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:47.109975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332274b2-4d75-4e31-8370-8dbaf7198e1d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:47.109975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332274b2-4d75-4e31-8370-8dbaf7198e1d None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:47.111395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:47.116193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f421a-bd2e-4bbc-9297-f3be1a0561a2 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:47.116604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f421a-bd2e-4bbc-9297-f3be1a0561a2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:47.116760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f421a-bd2e-4bbc-9297-f3be1a0561a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:47.135842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e72f421a-bd2e-4bbc-9297-f3be1a0561a2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:47.137664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e72f421a-bd2e-4bbc-9297-f3be1a0561a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:47.145426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:47.295781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332274b2-4d75-4e31-8370-8dbaf7198e1d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:47.309830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332274b2-4d75-4e31-8370-8dbaf7198e1d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:47.315969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9fd1b-a37b-49a9-8c0c-bdace25c4a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:47.316598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd1b-a37b-49a9-8c0c-bdace25c4a7e service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:47.316878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd1b-a37b-49a9-8c0c-bdace25c4a7e service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:47.317154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd1b-a37b-49a9-8c0c-bdace25c4a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:47.325660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9fd1b-a37b-49a9-8c0c-bdace25c4a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:47.327251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9fd1b-a37b-49a9-8c0c-bdace25c4a7e service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:47.336620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 700/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:48.212296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a84b-0d3e-4b68-a5d3-5dfa772dd2ba None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:48.212901 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a84b-0d3e-4b68-a5d3-5dfa772dd2ba None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:48.212901 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a84b-0d3e-4b68-a5d3-5dfa772dd2ba None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:48.214302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:48.219089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d863-6725-4cf6-869e-5967a1538a02 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:48.219515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d863-6725-4cf6-869e-5967a1538a02 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:48.219666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d863-6725-4cf6-869e-5967a1538a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:48.238006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-8e93d863-6725-4cf6-869e-5967a1538a02 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:48.239239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8e93d863-6725-4cf6-869e-5967a1538a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:48.247671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:48.397088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a84b-0d3e-4b68-a5d3-5dfa772dd2ba None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:48.411461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a84b-0d3e-4b68-a5d3-5dfa772dd2ba None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:48.416785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29082b4c-5681-42f1-b3b4-57ba0f7481bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:48.418568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082b4c-5681-42f1-b3b4-57ba0f7481bc service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:48.418568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082b4c-5681-42f1-b3b4-57ba0f7481bc service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:48.418568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082b4c-5681-42f1-b3b4-57ba0f7481bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:48.426406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29082b4c-5681-42f1-b3b4-57ba0f7481bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:48.428008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29082b4c-5681-42f1-b3b4-57ba0f7481bc service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:48.437402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 721/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:49.284460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756df6-66ee-49c8-8713-87dba01a5c3b None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.285021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756df6-66ee-49c8-8713-87dba01a5c3b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.285021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756df6-66ee-49c8-8713-87dba01a5c3b None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.286437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:49.291289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d643d-8bd7-4ed3-ba0c-d3226d71cbbf None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.291692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d643d-8bd7-4ed3-ba0c-d3226d71cbbf None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.291840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d643d-8bd7-4ed3-ba0c-d3226d71cbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.310008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7f3d643d-8bd7-4ed3-ba0c-d3226d71cbbf None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:49.311305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7f3d643d-8bd7-4ed3-ba0c-d3226d71cbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:49.319024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:49.467841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756df6-66ee-49c8-8713-87dba01a5c3b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:49.482506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756df6-66ee-49c8-8713-87dba01a5c3b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:49.488152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560adb-55e0-4ba3-8d49-ad36634f6fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:49.488783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560adb-55e0-4ba3-8d49-ad36634f6fa4 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.489070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560adb-55e0-4ba3-8d49-ad36634f6fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.489353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560adb-55e0-4ba3-8d49-ad36634f6fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.498435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560adb-55e0-4ba3-8d49-ad36634f6fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:49.500047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560adb-55e0-4ba3-8d49-ad36634f6fa4 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:49.509560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 703/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:50.424030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224a68-6477-4e02-b685-3f17cd9a074d None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.424556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224a68-6477-4e02-b685-3f17cd9a074d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.424556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224a68-6477-4e02-b685-3f17cd9a074d None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:50.425929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:50.431004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb275c-9983-4ce5-b54d-e8cca08303b9 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.431393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb275c-9983-4ce5-b54d-e8cca08303b9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.431570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb275c-9983-4ce5-b54d-e8cca08303b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:50.450390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-32bb275c-9983-4ce5-b54d-e8cca08303b9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:50.451615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-32bb275c-9983-4ce5-b54d-e8cca08303b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:50.459451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:50.610322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2224a68-6477-4e02-b685-3f17cd9a074d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:50.625047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2224a68-6477-4e02-b685-3f17cd9a074d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:50.630368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f2fb0-4bb9-4895-b4b1-6d7c9cae032e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:50.631032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2fb0-4bb9-4895-b4b1-6d7c9cae032e service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.631314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2fb0-4bb9-4895-b4b1-6d7c9cae032e service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.631587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2fb0-4bb9-4895-b4b1-6d7c9cae032e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:50.640103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f2fb0-4bb9-4895-b4b1-6d7c9cae032e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:50.641671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f2fb0-4bb9-4895-b4b1-6d7c9cae032e service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:50.650923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 724/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:51.519238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008071-33e2-4920-b8be-426a467cc342 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:51.519774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008071-33e2-4920-b8be-426a467cc342 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:51.519774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008071-33e2-4920-b8be-426a467cc342 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.521096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:00:51.525895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789744f-8341-435e-884f-a8dc7266a60e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:51.526310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789744f-8341-435e-884f-a8dc7266a60e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:51.526459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789744f-8341-435e-884f-a8dc7266a60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.545000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e789744f-8341-435e-884f-a8dc7266a60e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:51.546194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e789744f-8341-435e-884f-a8dc7266a60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:51.553846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:51.703477 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008071-33e2-4920-b8be-426a467cc342 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:51.718133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008071-33e2-4920-b8be-426a467cc342 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:51.723654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c184c78-1b5d-4920-9b43-b72ebfb5c1ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:51.724293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184c78-1b5d-4920-9b43-b72ebfb5c1ea service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:51.724606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184c78-1b5d-4920-9b43-b72ebfb5c1ea service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:51.724885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184c78-1b5d-4920-9b43-b72ebfb5c1ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.733687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c184c78-1b5d-4920-9b43-b72ebfb5c1ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:51.735564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c184c78-1b5d-4920-9b43-b72ebfb5c1ea service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:51.744695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 706/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:52.584248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b513-59fb-4b2c-be48-6d9c3f6f2a40 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:52.584808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b513-59fb-4b2c-be48-6d9c3f6f2a40 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:52.584808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b513-59fb-4b2c-be48-6d9c3f6f2a40 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:52.586191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:52.591602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2cd11-75d8-4541-90bc-faac1bc4d9eb None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:52.591998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2cd11-75d8-4541-90bc-faac1bc4d9eb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:52.592156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2cd11-75d8-4541-90bc-faac1bc4d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:52.610630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3fa2cd11-75d8-4541-90bc-faac1bc4d9eb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:52.611788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3fa2cd11-75d8-4541-90bc-faac1bc4d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:52.620420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:52.771620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042b513-59fb-4b2c-be48-6d9c3f6f2a40 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:52.786475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042b513-59fb-4b2c-be48-6d9c3f6f2a40 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:52.791852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3ddfd-d51c-4a1b-9973-6dd41d37cbd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:52.792500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3ddfd-d51c-4a1b-9973-6dd41d37cbd7 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:52.792817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3ddfd-d51c-4a1b-9973-6dd41d37cbd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:52.793097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3ddfd-d51c-4a1b-9973-6dd41d37cbd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:52.801127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3ddfd-d51c-4a1b-9973-6dd41d37cbd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:52.802698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3ddfd-d51c-4a1b-9973-6dd41d37cbd7 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:52.812014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 727/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:53.675984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a6cbf-6bbb-4600-aef7-c659978865ae None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:53.676541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a6cbf-6bbb-4600-aef7-c659978865ae None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:53.676541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a6cbf-6bbb-4600-aef7-c659978865ae None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:53.677935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:53.682812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cec91d-645b-4f07-9892-d7a8bb2860e7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:53.683297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cec91d-645b-4f07-9892-d7a8bb2860e7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:53.683405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cec91d-645b-4f07-9892-d7a8bb2860e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:53.700921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a1cec91d-645b-4f07-9892-d7a8bb2860e7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:53.702108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a1cec91d-645b-4f07-9892-d7a8bb2860e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:53.709781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:53.859568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a6cbf-6bbb-4600-aef7-c659978865ae None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:53.873609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a6cbf-6bbb-4600-aef7-c659978865ae None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:53.878993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a021c-3cb4-4fa7-acde-13229a94a715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:53.879623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a021c-3cb4-4fa7-acde-13229a94a715 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:53.879907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a021c-3cb4-4fa7-acde-13229a94a715 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:53.880185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a021c-3cb4-4fa7-acde-13229a94a715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:53.888259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a021c-3cb4-4fa7-acde-13229a94a715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:53.889840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a021c-3cb4-4fa7-acde-13229a94a715 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:53.899094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 709/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:54.764659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085af03-c90a-4846-aad0-94753d0085d3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.765252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085af03-c90a-4846-aad0-94753d0085d3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.765252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085af03-c90a-4846-aad0-94753d0085d3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.766590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:54.771808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b5cbc-405a-44db-a70b-5983eda4d668 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.772272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b5cbc-405a-44db-a70b-5983eda4d668 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.772383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b5cbc-405a-44db-a70b-5983eda4d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.789901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b21b5cbc-405a-44db-a70b-5983eda4d668 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:54.791139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b21b5cbc-405a-44db-a70b-5983eda4d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:54.799470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:54.947936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085af03-c90a-4846-aad0-94753d0085d3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:54.962033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085af03-c90a-4846-aad0-94753d0085d3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:54.967343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe174-d9e8-4c6b-99f2-10de489e218d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:54.967974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe174-d9e8-4c6b-99f2-10de489e218d service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.968259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe174-d9e8-4c6b-99f2-10de489e218d service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.968540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe174-d9e8-4c6b-99f2-10de489e218d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.976477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fe174-d9e8-4c6b-99f2-10de489e218d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:54.978052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fe174-d9e8-4c6b-99f2-10de489e218d service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:54.988091 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 730/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:56.902867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110c49-8f27-4258-9f5d-767669e0bf9b None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.903407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110c49-8f27-4258-9f5d-767669e0bf9b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.903503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2110c49-8f27-4258-9f5d-767669e0bf9b None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.904819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:56.910102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef8e5-d4e1-4283-a3c1-56d8e233b5e1 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.910497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef8e5-d4e1-4283-a3c1-56d8e233b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.910668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef8e5-d4e1-4283-a3c1-56d8e233b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.928100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4ebef8e5-d4e1-4283-a3c1-56d8e233b5e1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:56.929289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4ebef8e5-d4e1-4283-a3c1-56d8e233b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:56.937527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:56.975815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110c49-8f27-4258-9f5d-767669e0bf9b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:56.986938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2110c49-8f27-4258-9f5d-767669e0bf9b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:56.990325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a220-40a7-4d7d-9246-5523630c8e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:56.990980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a220-40a7-4d7d-9246-5523630c8e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.991276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a220-40a7-4d7d-9246-5523630c8e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.991528 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a220-40a7-4d7d-9246-5523630c8e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.000641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a220-40a7-4d7d-9246-5523630c8e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:57.002048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a220-40a7-4d7d-9246-5523630c8e8a service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:57.011138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 712/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:59.198327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50d8fc-fcb4-4b55-a175-9e737a469a03 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.198737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50d8fc-fcb4-4b55-a175-9e737a469a03 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.198960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50d8fc-fcb4-4b55-a175-9e737a469a03 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.200337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:59.205608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1e40-2457-45d6-87d2-a4c9e67b4fad None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.206067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1e40-2457-45d6-87d2-a4c9e67b4fad None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.206180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1e40-2457-45d6-87d2-a4c9e67b4fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.224203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-079c1e40-2457-45d6-87d2-a4c9e67b4fad None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:59.225456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-079c1e40-2457-45d6-87d2-a4c9e67b4fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:59.234056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:59.274716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50d8fc-fcb4-4b55-a175-9e737a469a03 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:59.277623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cf50d8fc-fcb4-4b55-a175-9e737a469a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:59.296249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50d8fc-fcb4-4b55-a175-9e737a469a03 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:59.300069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f4c64-7b4e-445d-b041-6d45ce9aadac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:59.300728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4c64-7b4e-445d-b041-6d45ce9aadac service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.301012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4c64-7b4e-445d-b041-6d45ce9aadac service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.301292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4c64-7b4e-445d-b041-6d45ce9aadac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.311429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f4c64-7b4e-445d-b041-6d45ce9aadac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:59.312883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f4c64-7b4e-445d-b041-6d45ce9aadac service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:59.322157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 733/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:01.701714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdc73f-7df7-4987-859c-d7561ae48b07 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:01.702285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdc73f-7df7-4987-859c-d7561ae48b07 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:01.702285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdc73f-7df7-4987-859c-d7561ae48b07 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:01.703657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:01.708749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7ee6-138e-4dfa-86e7-b450f024b47d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:01.709171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7ee6-138e-4dfa-86e7-b450f024b47d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:01.709282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7ee6-138e-4dfa-86e7-b450f024b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:01.726532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-828a7ee6-138e-4dfa-86e7-b450f024b47d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:01.727734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-828a7ee6-138e-4dfa-86e7-b450f024b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:01.736162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:01.773972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdc73f-7df7-4987-859c-d7561ae48b07 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:01.784710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdc73f-7df7-4987-859c-d7561ae48b07 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:01.788269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41fd9d-3f3d-4b16-9d34-7bbbf8f24f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:01.788900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fd9d-3f3d-4b16-9d34-7bbbf8f24f80 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:01.789209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fd9d-3f3d-4b16-9d34-7bbbf8f24f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:01.789483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fd9d-3f3d-4b16-9d34-7bbbf8f24f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:01.798735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41fd9d-3f3d-4b16-9d34-7bbbf8f24f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:01.800188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41fd9d-3f3d-4b16-9d34-7bbbf8f24f80 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:01.810060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 715/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:03.950010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74127-2b94-4dc3-ac50-1948dad9287c None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.950574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74127-2b94-4dc3-ac50-1948dad9287c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.950574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74127-2b94-4dc3-ac50-1948dad9287c None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.952080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:03.957241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7c3ec-33b6-483b-9270-d55bbd199099 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.957682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7c3ec-33b6-483b-9270-d55bbd199099 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.957841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7c3ec-33b6-483b-9270-d55bbd199099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.975792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-93e7c3ec-33b6-483b-9270-d55bbd199099 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:03.976993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-93e7c3ec-33b6-483b-9270-d55bbd199099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:03.985435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:04.023275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa74127-2b94-4dc3-ac50-1948dad9287c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:04.033642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa74127-2b94-4dc3-ac50-1948dad9287c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:04.037125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c314799-669b-4849-b9b1-ad156adadf2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:04.037752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c314799-669b-4849-b9b1-ad156adadf2e service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:04.038036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c314799-669b-4849-b9b1-ad156adadf2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:04.038312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c314799-669b-4849-b9b1-ad156adadf2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:04.047471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c314799-669b-4849-b9b1-ad156adadf2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:04.048876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c314799-669b-4849-b9b1-ad156adadf2e service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:04.058704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 736/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:06.396262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46b8f5-c116-4c1f-b261-fdb4886fe626 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:06.396794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46b8f5-c116-4c1f-b261-fdb4886fe626 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:06.396911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46b8f5-c116-4c1f-b261-fdb4886fe626 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:06.398212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:06.403358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b0d5-0b09-4363-9d79-0a002a35d3a9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:06.406899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b0d5-0b09-4363-9d79-0a002a35d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:06.406899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b0d5-0b09-4363-9d79-0a002a35d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:06.421446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c8c9b0d5-0b09-4363-9d79-0a002a35d3a9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:06.422693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c8c9b0d5-0b09-4363-9d79-0a002a35d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:06.430389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:06.468069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46b8f5-c116-4c1f-b261-fdb4886fe626 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:06.478696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46b8f5-c116-4c1f-b261-fdb4886fe626 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:06.482317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b1368-1f13-4fed-a452-cd27e90f26b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:06.482985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b1368-1f13-4fed-a452-cd27e90f26b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:06.483271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b1368-1f13-4fed-a452-cd27e90f26b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:06.483549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b1368-1f13-4fed-a452-cd27e90f26b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:06.492613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b1368-1f13-4fed-a452-cd27e90f26b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:06.494032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b1368-1f13-4fed-a452-cd27e90f26b9 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:06.503770 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 718/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:08.584589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ea0d6-779e-40e9-b8a9-17e28a496723 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.585164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ea0d6-779e-40e9-b8a9-17e28a496723 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.585164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ea0d6-779e-40e9-b8a9-17e28a496723 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.586538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:08.592389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554876f-6b3e-4011-a22f-b369cc27e636 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.592814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554876f-6b3e-4011-a22f-b369cc27e636 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.592938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554876f-6b3e-4011-a22f-b369cc27e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.610466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d554876f-6b3e-4011-a22f-b369cc27e636 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:08.611610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d554876f-6b3e-4011-a22f-b369cc27e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:08.619201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:08.657047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ea0d6-779e-40e9-b8a9-17e28a496723 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:08.667632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ea0d6-779e-40e9-b8a9-17e28a496723 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:08.671143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80431d95-e5ac-4220-8b27-3009968ce054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:08.671776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431d95-e5ac-4220-8b27-3009968ce054 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.672063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431d95-e5ac-4220-8b27-3009968ce054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.672341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80431d95-e5ac-4220-8b27-3009968ce054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.681267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80431d95-e5ac-4220-8b27-3009968ce054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:08.683282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80431d95-e5ac-4220-8b27-3009968ce054 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:08.692645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 739/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:10.782585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb4423-45f0-4704-a7cd-530b446d2161 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:10.783034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb4423-45f0-4704-a7cd-530b446d2161 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:10.783181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb4423-45f0-4704-a7cd-530b446d2161 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:10.784669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:10.790240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee330e-c6c5-4236-8520-bef2eca6d74e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:10.790691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee330e-c6c5-4236-8520-bef2eca6d74e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:10.790803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee330e-c6c5-4236-8520-bef2eca6d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:10.808333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-85ee330e-c6c5-4236-8520-bef2eca6d74e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:10.809533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-85ee330e-c6c5-4236-8520-bef2eca6d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:10.817315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:10.855966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb4423-45f0-4704-a7cd-530b446d2161 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:10.866864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb4423-45f0-4704-a7cd-530b446d2161 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:10.871380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017c37-2ea8-425d-8798-a5f042cbc31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:10.872020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017c37-2ea8-425d-8798-a5f042cbc31f service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:10.872323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017c37-2ea8-425d-8798-a5f042cbc31f service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:10.872598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017c37-2ea8-425d-8798-a5f042cbc31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:10.881562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017c37-2ea8-425d-8798-a5f042cbc31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:10.883009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017c37-2ea8-425d-8798-a5f042cbc31f service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:10.892784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 721/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:12.959581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823052d-2b93-4626-9eab-bf736b9c6a5e None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.960148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823052d-2b93-4626-9eab-bf736b9c6a5e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.960148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823052d-2b93-4626-9eab-bf736b9c6a5e None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.961527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:12.967348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c046eda-9b5a-4623-8152-8eeab32247ad None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.967786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c046eda-9b5a-4623-8152-8eeab32247ad None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.967912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c046eda-9b5a-4623-8152-8eeab32247ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.974112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=79 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:12.986177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-0c046eda-9b5a-4623-8152-8eeab32247ad None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:12.987421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0c046eda-9b5a-4623-8152-8eeab32247ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:12.995267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:13.033819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823052d-2b93-4626-9eab-bf736b9c6a5e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:13.039145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=73 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:13.044737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823052d-2b93-4626-9eab-bf736b9c6a5e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:13.048352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837463de-d4cc-4808-8032-a6ed49b37896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:13.053811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837463de-d4cc-4808-8032-a6ed49b37896 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.053811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837463de-d4cc-4808-8032-a6ed49b37896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.053811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837463de-d4cc-4808-8032-a6ed49b37896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.058583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837463de-d4cc-4808-8032-a6ed49b37896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:13.060028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837463de-d4cc-4808-8032-a6ed49b37896 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:13.069199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 742/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:15.150805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04760e-e1e5-48e9-b0cb-9b7156f7f373 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:15.151430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04760e-e1e5-48e9-b0cb-9b7156f7f373 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:15.151430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04760e-e1e5-48e9-b0cb-9b7156f7f373 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:15.152799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:15.158266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832968b8-b6b3-4892-a336-a2d37e8cbdce None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:15.158732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832968b8-b6b3-4892-a336-a2d37e8cbdce None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:15.158865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832968b8-b6b3-4892-a336-a2d37e8cbdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:15.176988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-832968b8-b6b3-4892-a336-a2d37e8cbdce None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:15.178193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-832968b8-b6b3-4892-a336-a2d37e8cbdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:15.186601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:15.222901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04760e-e1e5-48e9-b0cb-9b7156f7f373 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:15.234361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04760e-e1e5-48e9-b0cb-9b7156f7f373 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:15.237914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c0699-6b6e-4ba8-b572-a4dd7a9b0de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:15.238551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0699-6b6e-4ba8-b572-a4dd7a9b0de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:15.238861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0699-6b6e-4ba8-b572-a4dd7a9b0de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:15.239142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c0699-6b6e-4ba8-b572-a4dd7a9b0de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:15.248613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c0699-6b6e-4ba8-b572-a4dd7a9b0de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:15.252249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c0699-6b6e-4ba8-b572-a4dd7a9b0de4 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:15.259536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 724/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:17.304203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a00db5-9045-4aa4-be7a-2ed37970212b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.304780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a00db5-9045-4aa4-be7a-2ed37970212b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.304780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a00db5-9045-4aa4-be7a-2ed37970212b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.306129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:17.311330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5a016-a086-4132-9d3a-c3fe73a3a45c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.311762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5a016-a086-4132-9d3a-c3fe73a3a45c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.311879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5a016-a086-4132-9d3a-c3fe73a3a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.329753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-aad5a016-a086-4132-9d3a-c3fe73a3a45c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:17.330964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-aad5a016-a086-4132-9d3a-c3fe73a3a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.339306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:17.375470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a00db5-9045-4aa4-be7a-2ed37970212b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.386664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a00db5-9045-4aa4-be7a-2ed37970212b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.390183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d4e5c-7c48-42bc-bb81-cb9f0134b136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.390846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4e5c-7c48-42bc-bb81-cb9f0134b136 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.391136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4e5c-7c48-42bc-bb81-cb9f0134b136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.391417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4e5c-7c48-42bc-bb81-cb9f0134b136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.400289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d4e5c-7c48-42bc-bb81-cb9f0134b136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.402329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d4e5c-7c48-42bc-bb81-cb9f0134b136 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.411665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 745/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:27.324799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=11 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:27.407484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=14 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:37.173585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ed8d-67ef-4878-b247-d1704177e10e None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.174202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ed8d-67ef-4878-b247-d1704177e10e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.174202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167ed8d-67ef-4878-b247-d1704177e10e None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.175558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 726/1471] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:37.180941 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d14f-748d-40dc-a16b-933bd06b0f73 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.181361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d14f-748d-40dc-a16b-933bd06b0f73 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.181504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d14f-748d-40dc-a16b-933bd06b0f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.198814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2bc5d14f-748d-40dc-a16b-933bd06b0f73 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:37.200030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2bc5d14f-748d-40dc-a16b-933bd06b0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:37.207840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 746/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:37.255277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f295f79-81a6-452b-a9e1-58b924222b92 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.255564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f295f79-81a6-452b-a9e1-58b924222b92 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.255842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f295f79-81a6-452b-a9e1-58b924222b92 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.257171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 727/1473] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jun 22 09:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:37.261857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794baba-86bf-4df8-873f-b2ce537507e1 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.262152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794baba-86bf-4df8-873f-b2ce537507e1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.262433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794baba-86bf-4df8-873f-b2ce537507e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.280556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7794baba-86bf-4df8-873f-b2ce537507e1 None None] MFA Rules not processed for user `99a49aca72844411b6bc1feff566cc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:37.281727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7794baba-86bf-4df8-873f-b2ce537507e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:37.288131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 747/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jun 22 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:37.295744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f295f79-81a6-452b-a9e1-58b924222b92 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.306054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f295f79-81a6-452b-a9e1-58b924222b92 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.309492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d452a3-4abd-4d5d-a760-72adbf568e14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.310109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d452a3-4abd-4d5d-a760-72adbf568e14 service glance] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.310391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d452a3-4abd-4d5d-a760-72adbf568e14 service glance] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.310664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d452a3-4abd-4d5d-a760-72adbf568e14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.319378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d452a3-4abd-4d5d-a760-72adbf568e14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.320807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d452a3-4abd-4d5d-a760-72adbf568e14 service glance] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.329902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 728/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:39.451082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd819-df52-426d-b2f3-660c1a0d45af None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.451637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd819-df52-426d-b2f3-660c1a0d45af None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.451637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd819-df52-426d-b2f3-660c1a0d45af None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.452994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 748/1476] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:39.458278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dec8b8-c11c-48ea-85f4-96d8203df8fe None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.458695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dec8b8-c11c-48ea-85f4-96d8203df8fe None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.458810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dec8b8-c11c-48ea-85f4-96d8203df8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.476092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-78dec8b8-c11c-48ea-85f4-96d8203df8fe None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:39.477275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-78dec8b8-c11c-48ea-85f4-96d8203df8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:39.485210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 729/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:39.509838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bd819-df52-426d-b2f3-660c1a0d45af None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.522206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bd819-df52-426d-b2f3-660c1a0d45af None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.526603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ed674-123f-4a97-ba7a-5b16719e22e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.527263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ed674-123f-4a97-ba7a-5b16719e22e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.527543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ed674-123f-4a97-ba7a-5b16719e22e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.527817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ed674-123f-4a97-ba7a-5b16719e22e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.528546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ed674-123f-4a97-ba7a-5b16719e22e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.530294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-b18ed674-123f-4a97-ba7a-5b16719e22e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:01:39.530294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:01:39.530294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:01:39.531458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ed674-123f-4a97-ba7a-5b16719e22e6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.549981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 749/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 22 09:01:39 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:41.563817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d220-411c-4a07-8158-9e65f9a01199 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.564414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d220-411c-4a07-8158-9e65f9a01199 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.564414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d220-411c-4a07-8158-9e65f9a01199 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.565721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 730/1479] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:41.570789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88e5a2-9654-4899-a8a9-e55dc9bf0ced None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.571769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88e5a2-9654-4899-a8a9-e55dc9bf0ced None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.572005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88e5a2-9654-4899-a8a9-e55dc9bf0ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.591193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0e88e5a2-9654-4899-a8a9-e55dc9bf0ced None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:41.592402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0e88e5a2-9654-4899-a8a9-e55dc9bf0ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.600175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 750/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:41.643928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664d220-411c-4a07-8158-9e65f9a01199 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.658074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664d220-411c-4a07-8158-9e65f9a01199 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:41.663451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7296ce6-158d-4e43-a1bb-edb3b4b3a0e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:41.664085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7296ce6-158d-4e43-a1bb-edb3b4b3a0e9 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.664378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7296ce6-158d-4e43-a1bb-edb3b4b3a0e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.664662 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7296ce6-158d-4e43-a1bb-edb3b4b3a0e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.672638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7296ce6-158d-4e43-a1bb-edb3b4b3a0e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:41.674208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7296ce6-158d-4e43-a1bb-edb3b4b3a0e9 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:41.684239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 731/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:43.890579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a9fd-5e28-4664-9487-7bc41e135bb6 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.891227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a9fd-5e28-4664-9487-7bc41e135bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.891227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a9fd-5e28-4664-9487-7bc41e135bb6 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.892549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 751/1482] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:43.897880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ef0ec-c1bf-4cf6-8cb4-e78375d35344 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.898302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ef0ec-c1bf-4cf6-8cb4-e78375d35344 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.898424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ef0ec-c1bf-4cf6-8cb4-e78375d35344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.916733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-073ef0ec-c1bf-4cf6-8cb4-e78375d35344 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:43.917921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-073ef0ec-c1bf-4cf6-8cb4-e78375d35344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.925564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 732/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:43.960970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a9fd-5e28-4664-9487-7bc41e135bb6 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:43.971848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a9fd-5e28-4664-9487-7bc41e135bb6 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.975261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0d2d7-3acc-492d-811a-5b31ed9bc9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.975885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0d2d7-3acc-492d-811a-5b31ed9bc9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.976165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0d2d7-3acc-492d-811a-5b31ed9bc9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.976434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0d2d7-3acc-492d-811a-5b31ed9bc9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.985970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0d2d7-3acc-492d-811a-5b31ed9bc9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:43.987404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0d2d7-3acc-492d-811a-5b31ed9bc9f8 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:43.996560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 752/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:46.076519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208428-67d6-4305-9694-aff071a62c94 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.077080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208428-67d6-4305-9694-aff071a62c94 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.077080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208428-67d6-4305-9694-aff071a62c94 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.078444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 733/1485] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:46.083547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d1690-937e-4ace-877b-dfbcb4faa45d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.083929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d1690-937e-4ace-877b-dfbcb4faa45d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.084095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d1690-937e-4ace-877b-dfbcb4faa45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.101994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-237d1690-937e-4ace-877b-dfbcb4faa45d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:46.103234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-237d1690-937e-4ace-877b-dfbcb4faa45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:46.111111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 753/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:46.149192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83208428-67d6-4305-9694-aff071a62c94 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.159854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83208428-67d6-4305-9694-aff071a62c94 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.163332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0adc04-87b4-48f0-bbde-c52075426bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.163963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0adc04-87b4-48f0-bbde-c52075426bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.164250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0adc04-87b4-48f0-bbde-c52075426bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.164537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0adc04-87b4-48f0-bbde-c52075426bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.173352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0adc04-87b4-48f0-bbde-c52075426bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.174776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0adc04-87b4-48f0-bbde-c52075426bfa service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.184651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 734/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:48.379111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197e8e3-c96e-489f-8162-9b6170c34270 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.379522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197e8e3-c96e-489f-8162-9b6170c34270 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.379663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197e8e3-c96e-489f-8162-9b6170c34270 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.381039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 754/1488] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:48.386849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f805e2-203b-450d-a604-4c9b22ae5153 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.387251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f805e2-203b-450d-a604-4c9b22ae5153 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.387420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f805e2-203b-450d-a604-4c9b22ae5153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.404748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-55f805e2-203b-450d-a604-4c9b22ae5153 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:48.405937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-55f805e2-203b-450d-a604-4c9b22ae5153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:48.413657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 735/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:48.455048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197e8e3-c96e-489f-8162-9b6170c34270 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:48.465672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197e8e3-c96e-489f-8162-9b6170c34270 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:48.469095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e2b1-a62e-433b-ab0b-27e2e52ff848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:48.469721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e2b1-a62e-433b-ab0b-27e2e52ff848 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.470000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e2b1-a62e-433b-ab0b-27e2e52ff848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.470271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e2b1-a62e-433b-ab0b-27e2e52ff848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.478933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e2b1-a62e-433b-ab0b-27e2e52ff848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:48.480334 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e2b1-a62e-433b-ab0b-27e2e52ff848 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:48.489844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 755/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:50.864688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d5f34-39e2-4324-8f32-5555e2bdcab3 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:50.865258 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d5f34-39e2-4324-8f32-5555e2bdcab3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:50.865258 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d5f34-39e2-4324-8f32-5555e2bdcab3 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:50.866636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 736/1491] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 22 09:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:50.872437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff41da-0482-413a-998f-b375cb473fbc None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:50.872882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff41da-0482-413a-998f-b375cb473fbc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:50.873071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff41da-0482-413a-998f-b375cb473fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:50.890696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ebff41da-0482-413a-998f-b375cb473fbc None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:50.895461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ebff41da-0482-413a-998f-b375cb473fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:50.899672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 756/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 22 09:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:50.938551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d5f34-39e2-4324-8f32-5555e2bdcab3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:50.949862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d5f34-39e2-4324-8f32-5555e2bdcab3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:50.953392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19b3d3-a3b7-4331-b4fb-1d52af75a626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:50.954036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19b3d3-a3b7-4331-b4fb-1d52af75a626 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:50.954322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19b3d3-a3b7-4331-b4fb-1d52af75a626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:50.954601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19b3d3-a3b7-4331-b4fb-1d52af75a626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:50.963521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19b3d3-a3b7-4331-b4fb-1d52af75a626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:50.964973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19b3d3-a3b7-4331-b4fb-1d52af75a626 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:50.974498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 737/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:00.885849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=33 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:00.970255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=33 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:23.615811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e756037-43d7-4a4d-afed-8f617c19a743 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:23.616368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e756037-43d7-4a4d-afed-8f617c19a743 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:23.616368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e756037-43d7-4a4d-afed-8f617c19a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:23.634417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3e756037-43d7-4a4d-afed-8f617c19a743 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:23.635643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3e756037-43d7-4a4d-afed-8f617c19a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:23.643708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 757/1494] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:23.653405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98973ab-878d-489d-8847-8af417caddb5 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:23.653906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98973ab-878d-489d-8847-8af417caddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:23.654009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98973ab-878d-489d-8847-8af417caddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:23.671313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b98973ab-878d-489d-8847-8af417caddb5 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:23.672498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b98973ab-878d-489d-8847-8af417caddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:23.680192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 738/1495] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:23.684445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e756037-43d7-4a4d-afed-8f617c19a743 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:23.694469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e756037-43d7-4a4d-afed-8f617c19a743 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:23.698953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:23.699593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:23.699873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:23.700144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:23.700858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:03:23.701158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:23.702157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:23.702157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:03:23.702157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:03:23.703056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:23.714772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 758/1496] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:03:23.722487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98973ab-878d-489d-8847-8af417caddb5 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:23.731431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98973ab-878d-489d-8847-8af417caddb5 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:23.736243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:23.736884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:23.737171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:23.737456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:23.738155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:23.739960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING py.warnings [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:23.739960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: warnings.warn(msg) Jun 22 09:03:23.739960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: Jun 22 09:03:23.741167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:23.860482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 739/1497] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:03:23 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:03:23.864788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:23.874687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea200a-d735-4a53-9937-d4efa976bb45 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:23.929221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:23.929881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:23.930168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:23.930441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:23.931161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:23.932335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:23.932335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:03:23.932335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:03:23.933527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:24.046884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 759/1498] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:03:23 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:03:24.051508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:24.062182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c8c8-8ddf-4e67-9e2c-bd51b92801ee admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:24.071200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:24.071879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.072162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.072440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.073174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:24.074183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING py.warnings [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:24.074183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: warnings.warn(msg) Jun 22 09:03:24.074183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: Jun 22 09:03:24.075109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:24.088692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 740/1499] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:24.093013 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:24.103439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9c9e3-c256-40ba-95b2-0da2142ff6bb admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:24.108837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26c0f-b1f8-47bf-bfd2-a4d814cd6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:24.109802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c0f-b1f8-47bf-bfd2-a4d814cd6fee admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.110220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c0f-b1f8-47bf-bfd2-a4d814cd6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.110568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c0f-b1f8-47bf-bfd2-a4d814cd6fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.111331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26c0f-b1f8-47bf-bfd2-a4d814cd6fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:24.112450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-5ef26c0f-b1f8-47bf-bfd2-a4d814cd6fee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:24.112450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:03:24.112450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:03:24.114135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26c0f-b1f8-47bf-bfd2-a4d814cd6fee admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:24.127283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 760/1500] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:24.132042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:24.142274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e74c0f-d006-4a3e-8908-5ef7133ebf6e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:24.146803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd318d55-a473-4179-9928-53d9945fe448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:24.147714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318d55-a473-4179-9928-53d9945fe448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.147998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318d55-a473-4179-9928-53d9945fe448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.148272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318d55-a473-4179-9928-53d9945fe448 admin admin] PATH_INFO: `/v3/projects/66412c36421c4e2682376bcd2b00c695/users/07b961764df14c438fb70fe8cb812663/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.163535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd318d55-a473-4179-9928-53d9945fe448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66412c36421c4e2682376bcd2b00c695, user_id=07b961764df14c438fb70fe8cb812663, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:24.164564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING py.warnings [None req-bd318d55-a473-4179-9928-53d9945fe448 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:24.164564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: warnings.warn(msg) Jun 22 09:03:24.164564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: Jun 22 09:03:24.166486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd318d55-a473-4179-9928-53d9945fe448 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:24.230071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 741/1501] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:03:24 2022] PUT /identity/v3/projects/66412c36421c4e2682376bcd2b00c695/users/07b961764df14c438fb70fe8cb812663/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:24.242135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fd51b-91a0-435c-afc4-fac40d1a510b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.242455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fd51b-91a0-435c-afc4-fac40d1a510b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.242738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fd51b-91a0-435c-afc4-fac40d1a510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.269725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e92fd51b-91a0-435c-afc4-fac40d1a510b None None] MFA Rules not processed for user `07b961764df14c438fb70fe8cb812663`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:24.271031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e92fd51b-91a0-435c-afc4-fac40d1a510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:24.335747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 761/1502] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:03:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:24.348774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3debbc8-b98d-4d3a-a069-f3241cfe0da3 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.349068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3debbc8-b98d-4d3a-a069-f3241cfe0da3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.349347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3debbc8-b98d-4d3a-a069-f3241cfe0da3 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.350937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 742/1503] 10.222.0.55 () {54 vars in 963 bytes} [Wed Jun 22 09:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:03:24.355896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18f61-ae63-4b17-a6cd-66142e188f3d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.356195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18f61-ae63-4b17-a6cd-66142e188f3d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.356478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18f61-ae63-4b17-a6cd-66142e188f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.375178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4ac18f61-ae63-4b17-a6cd-66142e188f3d None None] MFA Rules not processed for user `497a2c9e3fe04d9e85d513c9beb4f6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:24.376386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4ac18f61-ae63-4b17-a6cd-66142e188f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:24.421195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:24.429428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 762/1504] 10.222.0.55 () {58 vars in 1060 bytes} [Wed Jun 22 09:03:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:24.437175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3debbc8-b98d-4d3a-a069-f3241cfe0da3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:24.453038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3debbc8-b98d-4d3a-a069-f3241cfe0da3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:24.457469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:24.458616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.459172 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.459649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.469862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:24.471404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:24.484055 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 743/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:24.532272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109048e-6cd5-487c-bb40-8471720665d7 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.532781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109048e-6cd5-487c-bb40-8471720665d7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.533284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109048e-6cd5-487c-bb40-8471720665d7 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.536231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 763/1506] 10.222.0.55 () {52 vars in 829 bytes} [Wed Jun 22 09:03:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:03:24.540440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:24.604990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aded1-abee-49a6-98b7-20cdbdabea7a service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:24.609734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:24.610592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:24.610899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:24.611177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] PATH_INFO: `/v3/users/07b961764df14c438fb70fe8cb812663` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:24.612348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b961764df14c438fb70fe8cb812663)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:24.613937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING py.warnings [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:24.613937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: warnings.warn(msg) Jun 22 09:03:24.613937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: Jun 22 09:03:24.615294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:24.991673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b961764df14c438fb70fe8cb812663'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:25.058631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b961764df14c438fb70fe8cb812663'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:25.071278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b961764df14c438fb70fe8cb812663'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:25.074023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b961764df14c438fb70fe8cb812663'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:25.074023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b961764df14c438fb70fe8cb812663'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:25.089112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:25.096599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 744/1507] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:24 2022] DELETE /identity/v3/users/07b961764df14c438fb70fe8cb812663 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:25.101629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:25.102099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:25.102292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:25.120727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:25.122814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:25.180628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 764/1508] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:25.190242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:25.192219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:25.247570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a682e35-5071-4148-91e0-ec57d7140a7d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:25.251206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77de9e6-d14c-451a-bb87-b7231acfd69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:25.254935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de9e6-d14c-451a-bb87-b7231acfd69f service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:25.254935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de9e6-d14c-451a-bb87-b7231acfd69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:25.254935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de9e6-d14c-451a-bb87-b7231acfd69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:25.261657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77de9e6-d14c-451a-bb87-b7231acfd69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:25.263163 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77de9e6-d14c-451a-bb87-b7231acfd69f service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:25.273195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 745/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:25.729383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:25.730937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:25.743767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf17b4-e4b6-483a-a534-4c72149f84ba None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:25.748350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:25.749211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:25.749493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:25.749766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] PATH_INFO: `/v3/projects/66412c36421c4e2682376bcd2b00c695` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:25.750993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66412c36421c4e2682376bcd2b00c695)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:25.752000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:03:25.752000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:03:25.752000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:03:25.753202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:25.985731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66412c36421c4e2682376bcd2b00c695', 'request_id': 'req-1b07ae3c-349c-498c-8216-dfcebb20cc25'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:25.998648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66412c36421c4e2682376bcd2b00c695', 'request_id': 'req-1b07ae3c-349c-498c-8216-dfcebb20cc25'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:26.004712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66412c36421c4e2682376bcd2b00c695', 'request_id': 'req-1b07ae3c-349c-498c-8216-dfcebb20cc25'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:26.109837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] The token cache is being invalidate because project 66412c36421c4e2682376bcd2b00c695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:26.110509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:26.110745 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1b07ae3c-349c-498c-8216-dfcebb20cc25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:26.112447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 765/1510] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:25 2022] DELETE /identity/v3/projects/66412c36421c4e2682376bcd2b00c695 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:35.281346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:36.106192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:05.313685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e8e8-785b-47ce-a2ba-057747355f32 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:05.314314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e8e8-785b-47ce-a2ba-057747355f32 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:05.314314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e8e8-785b-47ce-a2ba-057747355f32 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:05.315702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:05.320392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f739-c810-424b-aed9-ae08269fef43 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:05.320822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f739-c810-424b-aed9-ae08269fef43 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:05.320955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f739-c810-424b-aed9-ae08269fef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:05.339423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2a49f739-c810-424b-aed9-ae08269fef43 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:05.340629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2a49f739-c810-424b-aed9-ae08269fef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:05.398231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:05:05.553758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e8e8-785b-47ce-a2ba-057747355f32 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:05.555695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fcb1e8e8-785b-47ce-a2ba-057747355f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:05.629958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e8e8-785b-47ce-a2ba-057747355f32 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:05.635302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25deab-f13d-4a09-91b0-32bb4d2758ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:05.635948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25deab-f13d-4a09-91b0-32bb4d2758ae service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:05.636234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25deab-f13d-4a09-91b0-32bb4d2758ae service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:05.636567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25deab-f13d-4a09-91b0-32bb4d2758ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:05.645115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25deab-f13d-4a09-91b0-32bb4d2758ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:05.646705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25deab-f13d-4a09-91b0-32bb4d2758ae service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:05.656000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 747/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:06.532359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b8619-4b93-4e0b-b577-cac717650dae None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:06.532961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b8619-4b93-4e0b-b577-cac717650dae None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:06.532961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b8619-4b93-4e0b-b577-cac717650dae None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:06.534815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:06.539689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953466-7553-47d4-bd47-387f1e199f09 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:06.540120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953466-7553-47d4-bd47-387f1e199f09 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:06.540239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953466-7553-47d4-bd47-387f1e199f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:06.558620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2c953466-7553-47d4-bd47-387f1e199f09 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:06.559800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2c953466-7553-47d4-bd47-387f1e199f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:06.567829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:06.718296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b8619-4b93-4e0b-b577-cac717650dae None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:06.733079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b8619-4b93-4e0b-b577-cac717650dae None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:06.738427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbfb71-3482-41fd-83d1-025aa9df9479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:06.739085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbfb71-3482-41fd-83d1-025aa9df9479 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:06.739371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbfb71-3482-41fd-83d1-025aa9df9479 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:06.739647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbfb71-3482-41fd-83d1-025aa9df9479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:06.750719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbfb71-3482-41fd-83d1-025aa9df9479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:06.753803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbfb71-3482-41fd-83d1-025aa9df9479 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:06.764848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 768/1516] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:07.001482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da70e-a4b2-4abb-9e79-0d648fd934f9 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:07.001801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da70e-a4b2-4abb-9e79-0d648fd934f9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:07.002089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5da70e-a4b2-4abb-9e79-0d648fd934f9 None None] PATH_INFO: `/v3` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:07.004010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 749/1517] 10.222.0.47 () {54 vars in 925 bytes} [Wed Jun 22 09:05:06 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:05:07.010644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec8cf1-38f2-4e13-8b8c-26104d82026f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:07.010971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec8cf1-38f2-4e13-8b8c-26104d82026f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:07.011255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec8cf1-38f2-4e13-8b8c-26104d82026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:07.029339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-16ec8cf1-38f2-4e13-8b8c-26104d82026f None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:07.030533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-16ec8cf1-38f2-4e13-8b8c-26104d82026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:07.090059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 769/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Jun 22 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:16.203030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f5763-3e8f-4b1f-9cb1-a39ea47266ac None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:16.203579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f5763-3e8f-4b1f-9cb1-a39ea47266ac None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:16.203579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f5763-3e8f-4b1f-9cb1-a39ea47266ac None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:16.204837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 750/1519] 10.222.0.55 () {54 vars in 960 bytes} [Wed Jun 22 09:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:16.210537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd991f-89fa-4015-a1f5-445309877159 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:16.210972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd991f-89fa-4015-a1f5-445309877159 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:16.211143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd991f-89fa-4015-a1f5-445309877159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:16.228516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-85dd991f-89fa-4015-a1f5-445309877159 None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:16.229696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-85dd991f-89fa-4015-a1f5-445309877159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:16.238265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 770/1520] 10.222.0.55 () {58 vars in 1057 bytes} [Wed Jun 22 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:16.245467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f5763-3e8f-4b1f-9cb1-a39ea47266ac None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:16.259020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f5763-3e8f-4b1f-9cb1-a39ea47266ac None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:16.263898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8581e0-3ecb-4651-a992-13c6e44e29e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:16.264519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8581e0-3ecb-4651-a992-13c6e44e29e8 service placement] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:16.264809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8581e0-3ecb-4651-a992-13c6e44e29e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:16.265086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8581e0-3ecb-4651-a992-13c6e44e29e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:16.273785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8581e0-3ecb-4651-a992-13c6e44e29e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:16.275413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8581e0-3ecb-4651-a992-13c6e44e29e8 service placement] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:16.284817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 751/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:17.989493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e74f-53a1-493f-a8ff-e64305b039fb None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:17.990037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e74f-53a1-493f-a8ff-e64305b039fb None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:17.990037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e74f-53a1-493f-a8ff-e64305b039fb None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:17.991456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:17.996327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91050eaa-64b6-48e9-9648-7b2aa644af02 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:17.996745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91050eaa-64b6-48e9-9648-7b2aa644af02 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:17.996896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91050eaa-64b6-48e9-9648-7b2aa644af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:18.014977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-91050eaa-64b6-48e9-9648-7b2aa644af02 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:18.016171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-91050eaa-64b6-48e9-9648-7b2aa644af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:18.023862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:18.175679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949e74f-53a1-493f-a8ff-e64305b039fb None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:18.189534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949e74f-53a1-493f-a8ff-e64305b039fb None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:18.197229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03074a-b182-49b4-bab4-c9db29da3981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:18.197229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03074a-b182-49b4-bab4-c9db29da3981 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:18.197229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03074a-b182-49b4-bab4-c9db29da3981 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:18.197229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03074a-b182-49b4-bab4-c9db29da3981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:18.204990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03074a-b182-49b4-bab4-c9db29da3981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:18.206613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03074a-b182-49b4-bab4-c9db29da3981 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:18.215927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 772/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:19.070983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6c5e-be51-4384-9065-96088fc84ff9 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:19.071561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6c5e-be51-4384-9065-96088fc84ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:19.071561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6c5e-be51-4384-9065-96088fc84ff9 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:19.072930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 09:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:19.077565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba8ec-3816-4fd2-a5a8-0c9c8e681e9c None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:19.077975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba8ec-3816-4fd2-a5a8-0c9c8e681e9c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:19.078121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba8ec-3816-4fd2-a5a8-0c9c8e681e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:19.096270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-dcdba8ec-3816-4fd2-a5a8-0c9c8e681e9c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:19.097477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dcdba8ec-3816-4fd2-a5a8-0c9c8e681e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:19.105523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 09:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:19.258575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6c5e-be51-4384-9065-96088fc84ff9 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:19.273370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6c5e-be51-4384-9065-96088fc84ff9 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:19.278692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048542-dd92-40c1-a044-a00dc74a6b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:19.279356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048542-dd92-40c1-a044-a00dc74a6b76 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:19.279646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048542-dd92-40c1-a044-a00dc74a6b76 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:19.279925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048542-dd92-40c1-a044-a00dc74a6b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:19.287967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048542-dd92-40c1-a044-a00dc74a6b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:19.289548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048542-dd92-40c1-a044-a00dc74a6b76 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:19.298868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 754/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:23.338027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce84bf-210a-48fc-a31b-08498c5d0abd None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:23.338546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce84bf-210a-48fc-a31b-08498c5d0abd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:23.338546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce84bf-210a-48fc-a31b-08498c5d0abd None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:23.339965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:23.345326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120468f7-eaf5-4abc-ac86-423572667d5f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:23.345754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120468f7-eaf5-4abc-ac86-423572667d5f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:23.345882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120468f7-eaf5-4abc-ac86-423572667d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:23.364370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-120468f7-eaf5-4abc-ac86-423572667d5f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:23.365549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-120468f7-eaf5-4abc-ac86-423572667d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:23.373247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:23.409205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce84bf-210a-48fc-a31b-08498c5d0abd None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:23.410894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9fce84bf-210a-48fc-a31b-08498c5d0abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:23.466578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce84bf-210a-48fc-a31b-08498c5d0abd None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:23.471405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478757c4-218d-4656-988e-3791ef1fee9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:23.471405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478757c4-218d-4656-988e-3791ef1fee9f service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:23.471405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478757c4-218d-4656-988e-3791ef1fee9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:23.471405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478757c4-218d-4656-988e-3791ef1fee9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:23.480366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478757c4-218d-4656-988e-3791ef1fee9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:23.481836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478757c4-218d-4656-988e-3791ef1fee9f service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:23.487260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:23.491832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 775/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:25.509023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb27be-8024-4a22-adc7-bc75a65d6d38 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:25.509554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb27be-8024-4a22-adc7-bc75a65d6d38 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:25.509668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb27be-8024-4a22-adc7-bc75a65d6d38 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:25.510999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:25.515980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923473c8-a847-4460-9a8b-8886c5aa3c55 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:25.516403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923473c8-a847-4460-9a8b-8886c5aa3c55 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:25.516534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923473c8-a847-4460-9a8b-8886c5aa3c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:25.535320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-923473c8-a847-4460-9a8b-8886c5aa3c55 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:25.536539 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-923473c8-a847-4460-9a8b-8886c5aa3c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:25.544349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:25.581686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb27be-8024-4a22-adc7-bc75a65d6d38 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:25.593184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb27be-8024-4a22-adc7-bc75a65d6d38 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:25.601625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa673be-ab62-41c3-959b-0090b0d44f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:25.602304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa673be-ab62-41c3-959b-0090b0d44f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:25.602628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa673be-ab62-41c3-959b-0090b0d44f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:25.602940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa673be-ab62-41c3-959b-0090b0d44f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:25.613154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa673be-ab62-41c3-959b-0090b0d44f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:25.614609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa673be-ab62-41c3-959b-0090b0d44f68 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:25.624246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 757/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:29.214084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3cd05-26e4-45fd-b46b-6d63e396d8ae None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:29.214671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3cd05-26e4-45fd-b46b-6d63e396d8ae None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:29.214671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3cd05-26e4-45fd-b46b-6d63e396d8ae None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:29.216020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:29.221666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a743a8-9bc3-428f-966c-16bfe1c5a1f1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:29.222105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a743a8-9bc3-428f-966c-16bfe1c5a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:29.222221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a743a8-9bc3-428f-966c-16bfe1c5a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:29.241966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-12a743a8-9bc3-428f-966c-16bfe1c5a1f1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:29.243215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-12a743a8-9bc3-428f-966c-16bfe1c5a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:29.250926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:29.552468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3cd05-26e4-45fd-b46b-6d63e396d8ae None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:29.554138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1aa3cd05-26e4-45fd-b46b-6d63e396d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:29.612639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3cd05-26e4-45fd-b46b-6d63e396d8ae None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:29.616131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e09e0-57c7-4117-a740-70ffbb937ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:29.616773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e09e0-57c7-4117-a740-70ffbb937ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:29.617056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e09e0-57c7-4117-a740-70ffbb937ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:29.617335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e09e0-57c7-4117-a740-70ffbb937ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:29.626022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e09e0-57c7-4117-a740-70ffbb937ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:29.627465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e09e0-57c7-4117-a740-70ffbb937ab1 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:29.636699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 778/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:31.676077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f339234-0c65-4cab-96d4-5c45bb6f1bb5 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:31.682576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f339234-0c65-4cab-96d4-5c45bb6f1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:31.682576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f339234-0c65-4cab-96d4-5c45bb6f1bb5 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:31.682576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:05:31.683158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bcf8-5bff-44b9-a7b2-6c8398180d99 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:31.683562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bcf8-5bff-44b9-a7b2-6c8398180d99 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:31.683713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bcf8-5bff-44b9-a7b2-6c8398180d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:31.702006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6977bcf8-5bff-44b9-a7b2-6c8398180d99 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:31.703236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6977bcf8-5bff-44b9-a7b2-6c8398180d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:31.711376 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 09:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:05:32.009519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f339234-0c65-4cab-96d4-5c45bb6f1bb5 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:32.011352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1f339234-0c65-4cab-96d4-5c45bb6f1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:32.024127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f339234-0c65-4cab-96d4-5c45bb6f1bb5 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:32.027853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a51de-69fd-408c-b159-5452ec68f75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:32.028484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a51de-69fd-408c-b159-5452ec68f75a service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:32.028766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a51de-69fd-408c-b159-5452ec68f75a service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:32.029067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a51de-69fd-408c-b159-5452ec68f75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:32.038138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a51de-69fd-408c-b159-5452ec68f75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:32.039567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a51de-69fd-408c-b159-5452ec68f75a service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:32.048616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 760/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:41.697014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=32 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:42.044595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=70 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:00.687515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70da37-1b1f-4805-8dfd-c986b813efea None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.688263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70da37-1b1f-4805-8dfd-c986b813efea None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.688263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70da37-1b1f-4805-8dfd-c986b813efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.712195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ff70da37-1b1f-4805-8dfd-c986b813efea None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:00.713422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ff70da37-1b1f-4805-8dfd-c986b813efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:00.724611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 780/1540] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:00.735959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53e2a-5738-4253-ac52-5d79c589e348 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.737027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53e2a-5738-4253-ac52-5d79c589e348 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.737542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd53e2a-5738-4253-ac52-5d79c589e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.761869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fbd53e2a-5738-4253-ac52-5d79c589e348 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:00.767355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fbd53e2a-5738-4253-ac52-5d79c589e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:00.779323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 761/1541] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:00.784981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70da37-1b1f-4805-8dfd-c986b813efea None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:00.795079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70da37-1b1f-4805-8dfd-c986b813efea None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:00.805960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b21f8-112c-409d-8504-06562b4b7cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:00.806641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b21f8-112c-409d-8504-06562b4b7cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.806969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b21f8-112c-409d-8504-06562b4b7cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.807220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b21f8-112c-409d-8504-06562b4b7cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.807959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b21f8-112c-409d-8504-06562b4b7cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:00.808260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b21f8-112c-409d-8504-06562b4b7cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:00.809875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b21f8-112c-409d-8504-06562b4b7cf7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:00.829529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 781/1542] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:00.846177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e761-a048-4f3b-a58e-939403809cb6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.847016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e761-a048-4f3b-a58e-939403809cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.847537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e761-a048-4f3b-a58e-939403809cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.866086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38e63-eb1f-48f8-afb9-08e133953761 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.866347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38e63-eb1f-48f8-afb9-08e133953761 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.866605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a38e63-eb1f-48f8-afb9-08e133953761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.878772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a257e761-a048-4f3b-a58e-939403809cb6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:00.880490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a257e761-a048-4f3b-a58e-939403809cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:00.898102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-30a38e63-eb1f-48f8-afb9-08e133953761 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:00.899331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-30a38e63-eb1f-48f8-afb9-08e133953761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:00.899886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 762/1543] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:00.903583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257e761-a048-4f3b-a58e-939403809cb6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:00.908856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 782/1544] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:00.910202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077cf7-fa88-42df-98ee-85e6ebede147 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.910487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077cf7-fa88-42df-98ee-85e6ebede147 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.917346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077cf7-fa88-42df-98ee-85e6ebede147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.920504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257e761-a048-4f3b-a58e-939403809cb6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:00.933041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ccf4-f9de-48b8-9942-e47573669e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:00.934129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ccf4-f9de-48b8-9942-e47573669e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.934770 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ccf4-f9de-48b8-9942-e47573669e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.935307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ccf4-f9de-48b8-9942-e47573669e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.936283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ccf4-f9de-48b8-9942-e47573669e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:00.940876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ccf4-f9de-48b8-9942-e47573669e51 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:00.949562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ea077cf7-fa88-42df-98ee-85e6ebede147 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:00.951314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ea077cf7-fa88-42df-98ee-85e6ebede147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:00.961856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 783/1545] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:00.963619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda96a6-c48e-479f-b6d4-c1c5c4a4ca6e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.964196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda96a6-c48e-479f-b6d4-c1c5c4a4ca6e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.964619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda96a6-c48e-479f-b6d4-c1c5c4a4ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.983196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9fda96a6-c48e-479f-b6d4-c1c5c4a4ca6e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:00.984448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9fda96a6-c48e-479f-b6d4-c1c5c4a4ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:00.992511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 784/1546] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:00.993927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd1f5-8ad6-4874-b13a-67c5673a60db None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.994223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd1f5-8ad6-4874-b13a-67c5673a60db None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.994503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd1f5-8ad6-4874-b13a-67c5673a60db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.012985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-357fd1f5-8ad6-4874-b13a-67c5673a60db None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.014386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-357fd1f5-8ad6-4874-b13a-67c5673a60db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.023574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 785/1547] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.024996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663c5b-c828-435f-ad97-001d1605f812 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.025297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663c5b-c828-435f-ad97-001d1605f812 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.025615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663c5b-c828-435f-ad97-001d1605f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.044984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 763/1548] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:00 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.044984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac298-529a-4e61-a8a6-f3e9dd428689 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.044984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac298-529a-4e61-a8a6-f3e9dd428689 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.044984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac298-529a-4e61-a8a6-f3e9dd428689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.046454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-54663c5b-c828-435f-ad97-001d1605f812 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.047843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-54663c5b-c828-435f-ad97-001d1605f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.063402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-05bac298-529a-4e61-a8a6-f3e9dd428689 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.065941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-05bac298-529a-4e61-a8a6-f3e9dd428689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.109524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 786/1549] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.112125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccd9b-2844-42b0-92ed-c4b9f3a07542 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.112125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccd9b-2844-42b0-92ed-c4b9f3a07542 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.112125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccd9b-2844-42b0-92ed-c4b9f3a07542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.125244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 764/1550] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.128220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f88bd-dd48-4441-a5f3-601cc3cb02af None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.128515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f88bd-dd48-4441-a5f3-601cc3cb02af None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.128829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f88bd-dd48-4441-a5f3-601cc3cb02af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.130051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9b9ccd9b-2844-42b0-92ed-c4b9f3a07542 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.139429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9b9ccd9b-2844-42b0-92ed-c4b9f3a07542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.141136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 787/1551] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.142066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccd9b-2844-42b0-92ed-c4b9f3a07542 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.149276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-319f88bd-dd48-4441-a5f3-601cc3cb02af None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.150485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-319f88bd-dd48-4441-a5f3-601cc3cb02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.151828 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccd9b-2844-42b0-92ed-c4b9f3a07542 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.158700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 765/1552] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.162109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.162241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24c98-ba91-465c-a9d9-2527910a84fd None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.162355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.162436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24c98-ba91-465c-a9d9-2527910a84fd None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.162524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.162620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24c98-ba91-465c-a9d9-2527910a84fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.162709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.162709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:01.162709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.163503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.182748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 788/1553] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:01.182748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.183096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-74f24c98-ba91-465c-a9d9-2527910a84fd None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.183096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-74f24c98-ba91-465c-a9d9-2527910a84fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.186543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f446caa-11af-4ef5-8858-0587aec05af4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.191831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388658c4-e3c8-43db-8841-52efc37d3a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.191980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 766/1554] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.192432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388658c4-e3c8-43db-8841-52efc37d3a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.192717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388658c4-e3c8-43db-8841-52efc37d3a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.192935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f24c98-ba91-465c-a9d9-2527910a84fd None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.193065 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388658c4-e3c8-43db-8841-52efc37d3a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.193815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388658c4-e3c8-43db-8841-52efc37d3a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:01.194121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388658c4-e3c8-43db-8841-52efc37d3a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.195738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388658c4-e3c8-43db-8841-52efc37d3a43 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.208712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 789/1555] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:01.209385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f24c98-ba91-465c-a9d9-2527910a84fd None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.209942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a2a3-7033-45be-9466-91d647cbb4b8 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.210231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a2a3-7033-45be-9466-91d647cbb4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.210564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a2a3-7033-45be-9466-91d647cbb4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.214274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.215025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.215414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.215955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.216725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.217814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING py.warnings [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:07:01.217814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: warnings.warn(msg) Jun 22 09:07:01.217814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: Jun 22 09:07:01.219062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.228042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3385a2a3-7033-45be-9466-91d647cbb4b8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.229518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3385a2a3-7033-45be-9466-91d647cbb4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.237463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 790/1556] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.238654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec688-dfb5-4aae-8cae-e86ca495c48c None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.240132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec688-dfb5-4aae-8cae-e86ca495c48c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.240132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec688-dfb5-4aae-8cae-e86ca495c48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.257072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-82fec688-dfb5-4aae-8cae-e86ca495c48c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.258213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-82fec688-dfb5-4aae-8cae-e86ca495c48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.266387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 791/1557] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.267554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc146f-47d6-4557-8b22-143a171d3a40 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.267837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc146f-47d6-4557-8b22-143a171d3a40 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.268110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc146f-47d6-4557-8b22-143a171d3a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.284568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-15dc146f-47d6-4557-8b22-143a171d3a40 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.285704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-15dc146f-47d6-4557-8b22-143a171d3a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.293606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 767/1558] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.293606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.293855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 792/1559] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.294170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc146f-47d6-4557-8b22-143a171d3a40 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.302351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d491ce-b30f-4732-8561-d009b8fdb3fa admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.305574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc146f-47d6-4557-8b22-143a171d3a40 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.307433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.308256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.308528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.308737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.309032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.309352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.309642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.309814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:01.309960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.310118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.310753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.311098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING py.warnings [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:07:01.311098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: warnings.warn(msg) Jun 22 09:07:01.311098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: Jun 22 09:07:01.311802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:07:01.311802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:07:01.311802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:07:01.313709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.313867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c895-ed77-4466-89eb-210a24c24e9e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.326113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 768/1560] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:01.327225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f91fa-867b-458b-a2e8-7083afc99529 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.327515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f91fa-867b-458b-a2e8-7083afc99529 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.327813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f91fa-867b-458b-a2e8-7083afc99529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.355383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-924f91fa-867b-458b-a2e8-7083afc99529 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:01.356612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-924f91fa-867b-458b-a2e8-7083afc99529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:01.368650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 769/1561] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:01.369275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f91fa-867b-458b-a2e8-7083afc99529 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.379396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f91fa-867b-458b-a2e8-7083afc99529 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.384076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.384706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.384991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.385270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.386009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.387902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.423725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 793/1562] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.430998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.466016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:01.485162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d442-cfd0-4634-9008-11062f971845 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.489766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.490428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.490712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.491021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.491752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:01.492056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.493654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.507053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 770/1563] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.507053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.507488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 794/1564] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:01.507601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.521270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc3abb-33ee-4f5d-9302-72986b02630f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.561929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:01.572534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99fd17-6b53-473d-8237-cdbe3a431180 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.577584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.579014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.580123 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.580123 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.580318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.580410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.580502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.580502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.581027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.581331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:01.581738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.582664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.583603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.592990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 795/1565] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:01.596060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.596180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 771/1566] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:01.596850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.604922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af86db6-0f5c-46c7-9853-777f15ec1ebf admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.610179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.610857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.611152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.611486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.612200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b3734-4303-4fdf-aeec-53d604a9e0d6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.612323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:01.612511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.614092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.616907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.617392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.617679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.617958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.618642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.620574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.627369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 796/1567] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:01.628172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.643036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd822da8-df79-4242-8915-0d5d188eeef3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.647598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.648267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.648547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.648801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.649514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:01.649812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.651404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.662558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 797/1568] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:01.666337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.674778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6817fb-1dff-4bfe-8a33-64e33a771ff7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.679283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.679907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.680191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.680471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.681143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.683022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.721305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 772/1569] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.721891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.782396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f526741-48ae-468b-a6eb-ccd626a24df3 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.787148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.787806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.788088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.788363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.789048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.791057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.804793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 798/1570] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.805661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.815020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afd2f3-50f6-4dc2-8093-a83c16772bda admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.819461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.820086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.820372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.820651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.821338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.823289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.890348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 773/1571] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.891456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.900789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222d75-9f7e-4194-a90e-47da4126bfa5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.905268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.906501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.906711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.907021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.907732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.909464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.919393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 774/1572] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:01.925293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 799/1573] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:01.925404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.925486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:01.934549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e48fe-afd7-4313-8d05-7db5fb9ea85b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.983942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d79c-7b6f-47ae-b634-6ad47758210d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:01.989219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.989900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.990182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.990460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.991179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.991780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:01.992433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:01.992717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:01.992994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:01.993130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:01.993817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:01.995747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.001558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:02.102588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 800/1574] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.103817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.118225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 775/1575] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:01 2022] POST /identity/v3/projects => generated 405 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.118225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.150567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:02.166089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cf08a-9ad7-410f-8c5e-af9215f81cf4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.183063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd9839-0295-4552-ae50-285921e0680d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.187823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.192807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.192807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.192807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.192807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.192807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.220195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.220845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.221127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.221403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.222078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.223975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.302532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 776/1576] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:02 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.303337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.312803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbc93-ae79-4cf6-9a09-214ad8ac9141 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.314857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 801/1577] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:02 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.315717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.376205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.377023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.377448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.377823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.378644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.380403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.384449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de812e2-0610-452d-adce-26d2f05d6d4c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.389651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.390863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 777/1578] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.391267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.391909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.392049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.392292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.393182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.394880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.403093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc0dc-3536-4263-8eb4-1c60a3a1547b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.404914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 802/1579] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.411223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.411341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.411341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.411341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.411341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] PATH_INFO: `/v3/projects/dfcacaecd4564e90bfc76ff7e77911da/users/0673a8903f56430f86f87b9447668300/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.416183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a492b-97cf-4b22-afdd-088f8d9262ec admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.420831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.421472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.421752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.422024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.422689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.424594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.425451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcacaecd4564e90bfc76ff7e77911da, user_id=0673a8903f56430f86f87b9447668300, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.428121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.507744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 778/1580] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:02 2022] PUT /identity/v3/projects/dfcacaecd4564e90bfc76ff7e77911da/users/0673a8903f56430f86f87b9447668300/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:02.508543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.532076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:02.538144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 803/1581] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:02 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.539014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.548984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03414f-b57e-4def-a8fb-1255867fe26b admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.572035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31bf4b-49f4-474f-86d4-d8db0c2e6305 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.576563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.577230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.577515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.577832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.579091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.580997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.606170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.606871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.607157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.607436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.608118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.610022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.702080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 779/1582] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:02 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.703784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.714136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 804/1583] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:02 2022] POST /identity/v3/users => generated 303 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.714438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e1c8c-5422-4b27-afed-4d311c0aa4ea admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.715241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.720689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.721353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.721640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.721921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.723200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.724286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.726413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220506-ce2f-4a1b-823e-1ef40adb4327 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.731390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.733149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.733149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.733149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.733586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.734574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 780/1584] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.735277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.735463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.746811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614109-f740-4c61-928c-12a4d700cb86 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.751806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.752455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.752827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.753108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.753823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.755394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.757415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:02.766712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 781/1585] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.767741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.777340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d9b0c-26f2-4bfa-9337-ba865ac5dec1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.781926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31f2a-99d9-487f-92ad-8ccba916a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.782566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31f2a-99d9-487f-92ad-8ccba916a480 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.783165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31f2a-99d9-487f-92ad-8ccba916a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.783165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31f2a-99d9-487f-92ad-8ccba916a480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.783868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31f2a-99d9-487f-92ad-8ccba916a480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.785425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31f2a-99d9-487f-92ad-8ccba916a480 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.795055 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 782/1586] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.796208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0040781-fcea-4dc1-9163-e027a135feba None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.797007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0040781-fcea-4dc1-9163-e027a135feba None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.797294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0040781-fcea-4dc1-9163-e027a135feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.814941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a0040781-fcea-4dc1-9163-e027a135feba None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:02.816157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a0040781-fcea-4dc1-9163-e027a135feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:02.819697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 805/1587] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:02 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:02.819697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.826978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b516-1486-4594-892e-9128c0139f76 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.827361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 783/1588] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:02.828302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0040781-fcea-4dc1-9163-e027a135feba None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.833286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.834403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.835063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.835063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.835957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.837716 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0040781-fcea-4dc1-9163-e027a135feba None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.837836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.842898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.843613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.843904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.844185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.844915 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.846498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.849335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 806/1589] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.850323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.858105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 784/1590] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.858105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.862785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692de1e-1060-439f-9904-d1f90efff589 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.866044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.866718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.867044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.867323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.867780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc986c0-8880-4f29-9269-3078d19c56c3 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.868040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.869768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.872593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.873332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.873617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.873892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.874605 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.876750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.880402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 807/1591] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.881176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.890277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 785/1592] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:02.890277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:02.890531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29218-bbd3-4921-ab09-819be8cea398 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.894869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.895733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.896013 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.896289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] PATH_INFO: `/v3/projects/aa1c1626dad34ae9a2216e46ffae4003/users/71ac6423996b4e5d906de9ff6986fb03/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.897347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fe0d7-6b03-49dd-887c-f1c274f8edf4 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:02.901786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:02.902631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:02.902941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:02.903219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] PATH_INFO: `/v3/projects/e45cee7cefba4c77a5f2f97769686105/users/d3e65b6545344a8fa585ec4720bdafb6/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:02.910670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1c1626dad34ae9a2216e46ffae4003, user_id=71ac6423996b4e5d906de9ff6986fb03, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.911740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:07:02.911740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:07:02.911740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:07:02.913667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:02.917735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45cee7cefba4c77a5f2f97769686105, user_id=d3e65b6545344a8fa585ec4720bdafb6, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:02.920471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.004943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 808/1593] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:02 2022] PUT /identity/v3/projects/aa1c1626dad34ae9a2216e46ffae4003/users/71ac6423996b4e5d906de9ff6986fb03/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:03.005766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.016347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 786/1594] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:02 2022] PUT /identity/v3/projects/e45cee7cefba4c77a5f2f97769686105/users/d3e65b6545344a8fa585ec4720bdafb6/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:03.017243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.069235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e067c3-0a64-484a-84e6-b5c97075e50a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.075545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19182206-3bab-4f2c-b3c7-88ee3ed9084b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.079254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.079841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.080130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.080414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.098236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:03.124387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.125604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.125890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.126165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.126930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.128508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.139003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 809/1595] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:03.139812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.144096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.145527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.149249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6e0b-0f1f-47ef-bc11-25491ffeb6a7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.154180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.154839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.155140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.155275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 787/1596] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:03.155460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.156076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.156180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.158113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.165843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4785df4-93e9-42ae-b1c6-df62249fb563 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.173373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 810/1597] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:03.173373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.174644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.175198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.175483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.175946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.176483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.178189 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.186022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731ddd8-2c24-4d63-a532-d8fa061048f2 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.193448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 788/1598] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:03.193448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.196435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9765d3-a3bd-4ea1-b2a1-2c0a73a82c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.197627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9765d3-a3bd-4ea1-b2a1-2c0a73a82c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.198143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9765d3-a3bd-4ea1-b2a1-2c0a73a82c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.198641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9765d3-a3bd-4ea1-b2a1-2c0a73a82c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.200031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9765d3-a3bd-4ea1-b2a1-2c0a73a82c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.201148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04125b-4b3d-494a-8267-9f39665f3258 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.203267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9765d3-a3bd-4ea1-b2a1-2c0a73a82c06 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.205892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.206773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.207089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.207371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] PATH_INFO: `/v3/projects/b887d876b7624299b5575036da211d6b/users/abcbf501ca754212a16bbfbb901944f7/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.215582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 811/1599] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:03.216673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc159d-be48-4dbf-a415-337b56aabfdf None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.216969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc159d-be48-4dbf-a415-337b56aabfdf None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.217224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc159d-be48-4dbf-a415-337b56aabfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.223165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b887d876b7624299b5575036da211d6b, user_id=abcbf501ca754212a16bbfbb901944f7, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.225846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.235651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-00cc159d-be48-4dbf-a415-337b56aabfdf None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:03.236838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-00cc159d-be48-4dbf-a415-337b56aabfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:03.244467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 812/1600] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:03.245687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173b82-006e-4dda-b71b-2093ce97e2d4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.245972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173b82-006e-4dda-b71b-2093ce97e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.246247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4173b82-006e-4dda-b71b-2093ce97e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.272530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e4173b82-006e-4dda-b71b-2093ce97e2d4 None None] MFA Rules not processed for user `d3e65b6545344a8fa585ec4720bdafb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:03.273749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e4173b82-006e-4dda-b71b-2093ce97e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:03.305398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 789/1601] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:03 2022] PUT /identity/v3/projects/b887d876b7624299b5575036da211d6b/users/abcbf501ca754212a16bbfbb901944f7/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:03.307023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.320218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:03.342571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 813/1602] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:03.344211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4173b82-006e-4dda-b71b-2093ce97e2d4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.357527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4173b82-006e-4dda-b71b-2093ce97e2d4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.389775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5d640-6071-451a-8a8d-3227a0e5b41e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.396990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.397800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.398211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.398490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.399258 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.400888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.412668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 790/1603] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:03.413442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.424021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.424757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299438c-687b-427b-be0c-a0816ba25615 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.428035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.428035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.428035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] PATH_INFO: `/v3/projects/a5f6cfeded344f279292678ce4edf36b/users/0e5efd0b9ce94f51998754c6eaa1cdcc/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.430117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.431153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.431449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.431728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] PATH_INFO: `/v3/projects/e06efd9f018749e3931f713b485d6f84/users/0a8cc558dee74179b538f20c1b90f44c/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.444540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f6cfeded344f279292678ce4edf36b, user_id=0e5efd0b9ce94f51998754c6eaa1cdcc, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.447649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.447856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06efd9f018749e3931f713b485d6f84, user_id=0a8cc558dee74179b538f20c1b90f44c, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.450719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.525549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 814/1604] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:03 2022] PUT /identity/v3/projects/a5f6cfeded344f279292678ce4edf36b/users/0e5efd0b9ce94f51998754c6eaa1cdcc/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:03.526486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.540995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:03.551404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 791/1605] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:03 2022] PUT /identity/v3/projects/e06efd9f018749e3931f713b485d6f84/users/0a8cc558dee74179b538f20c1b90f44c/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:03.555946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.557750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:03.592783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f08b1-1184-46f5-a18b-5a211f887bb8 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.615504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db8879-7b02-4dce-a9d7-e5c4c06ce03d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.619185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a294-342d-4e9c-8cef-526252d530db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.619859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a294-342d-4e9c-8cef-526252d530db service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.620143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a294-342d-4e9c-8cef-526252d530db service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.620422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a294-342d-4e9c-8cef-526252d530db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.651592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9e93-42ef-46a8-a3aa-203b5bb18d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.652487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e93-42ef-46a8-a3aa-203b5bb18d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.652775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e93-42ef-46a8-a3aa-203b5bb18d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.653059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e93-42ef-46a8-a3aa-203b5bb18d87 admin admin] PATH_INFO: `/v3/projects/c86d072c3df9460895499d6fba56760c/users/0566ccd565fd4a0a871a3644142debb0/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.668831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9e93-42ef-46a8-a3aa-203b5bb18d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86d072c3df9460895499d6fba56760c, user_id=0566ccd565fd4a0a871a3644142debb0, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.672240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9e93-42ef-46a8-a3aa-203b5bb18d87 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.687112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945a294-342d-4e9c-8cef-526252d530db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.689140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945a294-342d-4e9c-8cef-526252d530db service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.699491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 792/1606] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:03.700728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0725-a2e9-4a22-a254-59b5c6d9780c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.705183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0725-a2e9-4a22-a254-59b5c6d9780c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.705183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0725-a2e9-4a22-a254-59b5c6d9780c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.718768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-309b0725-a2e9-4a22-a254-59b5c6d9780c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:03.720014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-309b0725-a2e9-4a22-a254-59b5c6d9780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:03.729348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 793/1607] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:03.738015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448cfcb-646a-459a-9c75-f26a232af13f None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.738015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448cfcb-646a-459a-9c75-f26a232af13f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.738015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448cfcb-646a-459a-9c75-f26a232af13f None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.738015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 794/1608] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 22 09:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:03.738015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448cfcb-646a-459a-9c75-f26a232af13f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.749359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448cfcb-646a-459a-9c75-f26a232af13f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:03.754853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445c8c-167f-4482-a6f8-be08dd1948a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:03.755749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445c8c-167f-4482-a6f8-be08dd1948a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.756033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445c8c-167f-4482-a6f8-be08dd1948a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.756311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445c8c-167f-4482-a6f8-be08dd1948a0 admin admin] PATH_INFO: `/v3/projects/0159f3d4e6f34f22be2fc41642fc3e29/users/7fc7afbfc06e497ab51be591b95cc42a/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.773588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445c8c-167f-4482-a6f8-be08dd1948a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0159f3d4e6f34f22be2fc41642fc3e29, user_id=7fc7afbfc06e497ab51be591b95cc42a, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:03.776365 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445c8c-167f-4482-a6f8-be08dd1948a0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:03.823044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 815/1609] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:03 2022] PUT /identity/v3/projects/c86d072c3df9460895499d6fba56760c/users/0566ccd565fd4a0a871a3644142debb0/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:03.824347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1d9ce-0077-487e-8860-c2d5f67430ec None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.824641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1d9ce-0077-487e-8860-c2d5f67430ec None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.824924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1d9ce-0077-487e-8860-c2d5f67430ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.846998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:03.851524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2ea1d9ce-0077-487e-8860-c2d5f67430ec None None] MFA Rules not processed for user `0e5efd0b9ce94f51998754c6eaa1cdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:03.852756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2ea1d9ce-0077-487e-8860-c2d5f67430ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:03.859447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 795/1610] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:03 2022] PUT /identity/v3/projects/0159f3d4e6f34f22be2fc41642fc3e29/users/7fc7afbfc06e497ab51be591b95cc42a/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:03.859447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0550e9-c410-4079-9246-3432e158796e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.859447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0550e9-c410-4079-9246-3432e158796e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.859447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0550e9-c410-4079-9246-3432e158796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.877870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2c0550e9-c410-4079-9246-3432e158796e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:03.879135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2c0550e9-c410-4079-9246-3432e158796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:03.930853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 816/1611] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:03.932241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6168-0fe5-41ea-9206-9d8c4f8c6d31 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:03.932539 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6168-0fe5-41ea-9206-9d8c4f8c6d31 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:03.932816 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6168-0fe5-41ea-9206-9d8c4f8c6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:03.952570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-735d6168-0fe5-41ea-9206-9d8c4f8c6d31 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:03.953755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 796/1612] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:03.957447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-735d6168-0fe5-41ea-9206-9d8c4f8c6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:03.957568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0550e9-c410-4079-9246-3432e158796e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:03.990394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:04.013972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0550e9-c410-4079-9246-3432e158796e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.017461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25129fcf-24cb-4707-ad60-5e82f330fb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.018214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25129fcf-24cb-4707-ad60-5e82f330fb8f service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.018685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25129fcf-24cb-4707-ad60-5e82f330fb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.019000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25129fcf-24cb-4707-ad60-5e82f330fb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.028721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25129fcf-24cb-4707-ad60-5e82f330fb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.030344 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25129fcf-24cb-4707-ad60-5e82f330fb8f service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.037999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 817/1613] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 22 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:04.039369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62de35-2dab-4b82-a4f2-06f48e136293 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.039664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62de35-2dab-4b82-a4f2-06f48e136293 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.040000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62de35-2dab-4b82-a4f2-06f48e136293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.042888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 797/1614] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:04.044481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463963-9d5a-4b69-a894-c1c4912cb5d0 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.045150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463963-9d5a-4b69-a894-c1c4912cb5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.045627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463963-9d5a-4b69-a894-c1c4912cb5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.069212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-bf62de35-2dab-4b82-a4f2-06f48e136293 None None] MFA Rules not processed for user `0566ccd565fd4a0a871a3644142debb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:04.069212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bf62de35-2dab-4b82-a4f2-06f48e136293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:04.085188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d8463963-9d5a-4b69-a894-c1c4912cb5d0 None None] MFA Rules not processed for user `7fc7afbfc06e497ab51be591b95cc42a`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:04.086723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d8463963-9d5a-4b69-a894-c1c4912cb5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:04.155263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 818/1615] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:04.155263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62de35-2dab-4b82-a4f2-06f48e136293 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.158431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 798/1616] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:04.159550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463963-9d5a-4b69-a894-c1c4912cb5d0 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.169086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62de35-2dab-4b82-a4f2-06f48e136293 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.169243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463963-9d5a-4b69-a894-c1c4912cb5d0 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.173902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.174920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.175179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.175412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.176361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.176495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.176495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.176495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.177060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.179126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.186224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.187844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.197887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 799/1617] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:04.198859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.210954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5a14-233a-4c9a-b5b8-00116d50fa21 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.217957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.219823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.220116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.220485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.239197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:04.285818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.292196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.295581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 819/1618] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:04.295581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.306554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 800/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:04.308234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.322597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc090-f40a-41ad-b2be-669c30c697cb service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.404107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.405077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.405526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.406622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.407517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.408208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e352a-df6a-4402-b259-da44f72aaf40 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.409874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.414036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.415055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.416080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.416367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.417072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.419064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.551425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 801/1620] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:04.552070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.554494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 820/1621] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/projects => generated 405 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:04.555193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.576213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:04.621844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840f57-757e-4d9b-928b-8f90cd2645b1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.623183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404a823-8f9d-4f13-a1e7-9568c7325785 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.627380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.628103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49188f-c791-462c-a90d-e47db85dc5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.628426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.628720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.629069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.629569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49188f-c791-462c-a90d-e47db85dc5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.629964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.630448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49188f-c791-462c-a90d-e47db85dc5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.630957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49188f-c791-462c-a90d-e47db85dc5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.632043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49188f-c791-462c-a90d-e47db85dc5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.632164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.634312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49188f-c791-462c-a90d-e47db85dc5b8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.734891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 802/1622] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:04.734891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.744219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b1edf-7dee-436d-a7d8-7a3e3747df04 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.750142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.751509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.751638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.752281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.752825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.754874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.798387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 821/1623] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:04.799903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06124a6d-3ae3-4e01-8780-766332a79cb3 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.800198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06124a6d-3ae3-4e01-8780-766332a79cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.800476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06124a6d-3ae3-4e01-8780-766332a79cb3 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.802047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 822/1624] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 22 09:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:04.802890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06124a6d-3ae3-4e01-8780-766332a79cb3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.817800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06124a6d-3ae3-4e01-8780-766332a79cb3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.823239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.825601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.825601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.825601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.825601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.826861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.838005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 823/1625] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:04.841882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.851886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d2397-597c-475b-bb56-c4d4e12fcf07 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.858103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6926bd-c07e-477c-b136-12050fa42d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.859071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6926bd-c07e-477c-b136-12050fa42d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.859529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6926bd-c07e-477c-b136-12050fa42d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.859962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6926bd-c07e-477c-b136-12050fa42d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.860915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6926bd-c07e-477c-b136-12050fa42d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.862665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6926bd-c07e-477c-b136-12050fa42d68 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.878928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 824/1626] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:04.880629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61945b-229c-4d67-b9fb-b8c3482dd013 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.883346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61945b-229c-4d67-b9fb-b8c3482dd013 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.883346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61945b-229c-4d67-b9fb-b8c3482dd013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.901972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-1d61945b-229c-4d67-b9fb-b8c3482dd013 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:04.906361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1d61945b-229c-4d67-b9fb-b8c3482dd013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:04.913275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 803/1627] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:04.913275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:04.930558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a616-596e-43e5-9a71-ae3034750e42 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:04.936117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:04.937733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:04.938121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:04.938499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] PATH_INFO: `/v3/projects/2fa9985ff7ec48a6ab12c4e5070359de/users/3d47ec38b42b4a7cb8a0eed889c8dc80/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:04.960285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:04.963408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa9985ff7ec48a6ab12c4e5070359de, user_id=3d47ec38b42b4a7cb8a0eed889c8dc80, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:04.967685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:04.999350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 825/1628] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:07:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:05.002315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61945b-229c-4d67-b9fb-b8c3482dd013 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.018993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61945b-229c-4d67-b9fb-b8c3482dd013 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.024038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.025200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.025200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.025425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.026538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.027839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.039634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 826/1629] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:05.040298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.051328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbda92-9d09-4b2e-9427-08bb91d2c3cc admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.056187 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.060625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.060625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.060625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.060625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.060625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.074075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 827/1630] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:05.074075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.085382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 804/1631] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:04 2022] PUT /identity/v3/projects/2fa9985ff7ec48a6ab12c4e5070359de/users/3d47ec38b42b4a7cb8a0eed889c8dc80/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:05.088640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.169030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6534-8ead-42df-ba2c-fe35eb445ada admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.177773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:05.182731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8722-bd0b-40d5-a547-4d9c00720d49 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.192212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.198284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.198284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.198284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] PATH_INFO: `/v3/projects/cb0762c59f2d4cea8504bf7b2f911937/users/7c42ebe41fea498abf8fd6d6bba2912d/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.218133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0762c59f2d4cea8504bf7b2f911937, user_id=7c42ebe41fea498abf8fd6d6bba2912d, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.221478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.244212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.245338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.245826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.246271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.326416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 805/1632] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:05 2022] PUT /identity/v3/projects/cb0762c59f2d4cea8504bf7b2f911937/users/7c42ebe41fea498abf8fd6d6bba2912d/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:05.326416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.349993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.352110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.383754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 828/1633] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:05.384923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.420273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e7cf-b4fe-48f8-8e33-cb4187561fde service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.451983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d2ff-8854-4400-9646-258eb58d206b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.463398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.464315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.464651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.467268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] PATH_INFO: `/v3/projects/b1934c157e0e4433ae95b41801819afa/users/ef76042d819d4e9c99f13516cd9a8787/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.509111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1934c157e0e4433ae95b41801819afa, user_id=ef76042d819d4e9c99f13516cd9a8787, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.519811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.525175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b3c39-00b3-4234-960c-83b555f3b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.527312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3c39-00b3-4234-960c-83b555f3b632 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.527436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3c39-00b3-4234-960c-83b555f3b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.527642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b3c39-00b3-4234-960c-83b555f3b632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.529180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b3c39-00b3-4234-960c-83b555f3b632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.530935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b3c39-00b3-4234-960c-83b555f3b632 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.544798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 829/1634] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:05.544798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee185-b8ce-4f11-9f6a-c9ae0607b99d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.544798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee185-b8ce-4f11-9f6a-c9ae0607b99d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.544798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee185-b8ce-4f11-9f6a-c9ae0607b99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.593554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 806/1635] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:05 2022] PUT /identity/v3/projects/b1934c157e0e4433ae95b41801819afa/users/ef76042d819d4e9c99f13516cd9a8787/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:05.595032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.603538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-021ee185-b8ce-4f11-9f6a-c9ae0607b99d None None] MFA Rules not processed for user `7c42ebe41fea498abf8fd6d6bba2912d`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:05.604796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-021ee185-b8ce-4f11-9f6a-c9ae0607b99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:05.676967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:05.685799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 830/1636] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:05.686010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478cd00-4c84-4e90-9074-534b7a6f7551 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.686128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ee185-b8ce-4f11-9f6a-c9ae0607b99d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.697196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:05.703188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.703479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.703781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.706451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] PATH_INFO: `/v3/projects/2fa9985ff7ec48a6ab12c4e5070359de/users/3d47ec38b42b4a7cb8a0eed889c8dc80/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.710980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa9985ff7ec48a6ab12c4e5070359de, user_id=3d47ec38b42b4a7cb8a0eed889c8dc80, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.711279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ee185-b8ce-4f11-9f6a-c9ae0607b99d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.716214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.724481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.727061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.727354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.730839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.730839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.732188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.744435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 807/1637] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:05 2022] PUT /identity/v3/projects/2fa9985ff7ec48a6ab12c4e5070359de/users/3d47ec38b42b4a7cb8a0eed889c8dc80/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:05.761021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.761254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 831/1638] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:05.761254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:05.775484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ffc8-62f4-4e1d-b62a-280c232be24a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.864401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f05b6f-3a2d-4d55-82fb-4fda66f14268 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:05.870341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1ddb-d93b-4a40-bd46-cec7d476f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.871075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1ddb-d93b-4a40-bd46-cec7d476f96d admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.871363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1ddb-d93b-4a40-bd46-cec7d476f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.871505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e7455-bf81-455f-8d5d-1a047190bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:05.871996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1ddb-d93b-4a40-bd46-cec7d476f96d admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.872375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b1ddb-d93b-4a40-bd46-cec7d476f96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.873773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7455-bf81-455f-8d5d-1a047190bc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.874255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7455-bf81-455f-8d5d-1a047190bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.875361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7455-bf81-455f-8d5d-1a047190bc87 admin admin] PATH_INFO: `/v3/projects/b1934c157e0e4433ae95b41801819afa/users/ef76042d819d4e9c99f13516cd9a8787/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.877831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b1ddb-d93b-4a40-bd46-cec7d476f96d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.882198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e7455-bf81-455f-8d5d-1a047190bc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1934c157e0e4433ae95b41801819afa, user_id=ef76042d819d4e9c99f13516cd9a8787, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:05.885665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e7455-bf81-455f-8d5d-1a047190bc87 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:05.898371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 832/1639] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:05 2022] PUT /identity/v3/projects/b1934c157e0e4433ae95b41801819afa/users/ef76042d819d4e9c99f13516cd9a8787/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:05.900495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb13cb-bce2-49e0-bc00-3f03e98d6b39 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.901411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb13cb-bce2-49e0-bc00-3f03e98d6b39 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.901925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb13cb-bce2-49e0-bc00-3f03e98d6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:05.937930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-fbcb13cb-bce2-49e0-bc00-3f03e98d6b39 None None] MFA Rules not processed for user `3d47ec38b42b4a7cb8a0eed889c8dc80`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:05.939342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fbcb13cb-bce2-49e0-bc00-3f03e98d6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:05.972000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 808/1640] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:05 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:05.974073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7d8f-309f-4fb2-867d-3dad7ab3600f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:05.974550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7d8f-309f-4fb2-867d-3dad7ab3600f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:05.975210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7d8f-309f-4fb2-867d-3dad7ab3600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.014404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f51f7d8f-309f-4fb2-867d-3dad7ab3600f None None] MFA Rules not processed for user `ef76042d819d4e9c99f13516cd9a8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:06.019573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f51f7d8f-309f-4fb2-867d-3dad7ab3600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:06.087010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 833/1641] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:06.088127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb13cb-bce2-49e0-bc00-3f03e98d6b39 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:06.123856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 809/1642] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:06.125840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f7d8f-309f-4fb2-867d-3dad7ab3600f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:06.213802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f7d8f-309f-4fb2-867d-3dad7ab3600f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:06.219741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:06.221053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:06.221631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:06.222057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.247258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:06.272482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb13cb-bce2-49e0-bc00-3f03e98d6b39 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:06.308525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:06.310182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:06.326191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 810/1643] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:06.399856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:06.400551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:06.401030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:06.401316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.402406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:06.408485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:06.515443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:06.524350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11162998-2ef3-43d8-b513-6ac7cde4767b service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:06.528734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 834/1644] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:06 2022] POST /identity/v3/users => generated 299 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:06.529976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:06.537304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:06.538969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:06.539329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:06.539674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.554776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928d0a-3a31-46e8-92dd-d32c4d5febc7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:06.557979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:06.560681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:06.561861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:06.562606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:06.562945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:06.563228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.563958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:06.565564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:06.586886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 835/1645] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:06.595366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:06.607252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 811/1646] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:06.610301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4c4d-6c3e-43c0-b5c8-32c8e192a038 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:06.615391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:06.616295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:06.616585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:06.616736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:06.616887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] PATH_INFO: `/v3/projects/1c269d83371c4c07b0ec66506939b983/users/ca71a98f58c843bc84023f1d04c41200/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.641823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c269d83371c4c07b0ec66506939b983, user_id=ca71a98f58c843bc84023f1d04c41200, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:06.653313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:06.754690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:06.754690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7585-7d07-40a8-8175-7248598461fe service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:06.754690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:06.754690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:06.757187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:06.757187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.783017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 836/1647] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:06 2022] PUT /identity/v3/projects/1c269d83371c4c07b0ec66506939b983/users/ca71a98f58c843bc84023f1d04c41200/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:06.786762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:06.938769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:06.940903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:06.965107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322cb62-9ad1-4b8e-9715-7191e2a74881 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:06.969320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 812/1648] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:06.975151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e909e-a365-4610-85cf-c989080039cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:06.975838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e909e-a365-4610-85cf-c989080039cd admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:06.976126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e909e-a365-4610-85cf-c989080039cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:06.976406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e909e-a365-4610-85cf-c989080039cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:06.977146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e909e-a365-4610-85cf-c989080039cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:06.979050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e909e-a365-4610-85cf-c989080039cd admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:07.014329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 837/1649] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:07:07.018807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:07.035059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7a3a-d5fb-4379-955d-5daf5fae938f service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:07.055505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:07.056784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.057295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.070427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] PATH_INFO: `/v3/projects/1c269d83371c4c07b0ec66506939b983/users/ca71a98f58c843bc84023f1d04c41200/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.081589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c269d83371c4c07b0ec66506939b983, user_id=ca71a98f58c843bc84023f1d04c41200, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:07.098012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:07.121556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 813/1650] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:07 2022] PUT /identity/v3/projects/1c269d83371c4c07b0ec66506939b983/users/ca71a98f58c843bc84023f1d04c41200/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:07.133681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d172-e881-41c5-81aa-e6feac2be233 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.134352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d172-e881-41c5-81aa-e6feac2be233 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.135224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d172-e881-41c5-81aa-e6feac2be233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.157874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:07.232208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-00b8d172-e881-41c5-81aa-e6feac2be233 None None] MFA Rules not processed for user `ca71a98f58c843bc84023f1d04c41200`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:07.234535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-00b8d172-e881-41c5-81aa-e6feac2be233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:07.286112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d610a3-b986-4421-b3eb-d6f6042e7852 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:07.293583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:07.295067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.295427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.295782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] PATH_INFO: `/v3/users/0566ccd565fd4a0a871a3644142debb0` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.297672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0566ccd565fd4a0a871a3644142debb0)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:07.299759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:07.393383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 838/1651] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:07.416208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d172-e881-41c5-81aa-e6feac2be233 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:07.538638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d172-e881-41c5-81aa-e6feac2be233 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:07.550963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05154-5ad0-420d-b1cf-f6700af379f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:07.551639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05154-5ad0-420d-b1cf-f6700af379f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.551929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05154-5ad0-420d-b1cf-f6700af379f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.552207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05154-5ad0-420d-b1cf-f6700af379f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.568615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0566ccd565fd4a0a871a3644142debb0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:07.597559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05154-5ad0-420d-b1cf-f6700af379f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:07.599086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05154-5ad0-420d-b1cf-f6700af379f6 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:07.612061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 839/1652] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:07.657124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0566ccd565fd4a0a871a3644142debb0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:07.666961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0566ccd565fd4a0a871a3644142debb0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:07.669960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0566ccd565fd4a0a871a3644142debb0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:07.670455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-685b8aa7-39c5-4ffc-b133-cf7756c40b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0566ccd565fd4a0a871a3644142debb0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:07.683697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35e81-4ff2-4ee0-a80b-01589642a065 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.684097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35e81-4ff2-4ee0-a80b-01589642a065 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.684480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35e81-4ff2-4ee0-a80b-01589642a065 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.686883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 840/1653] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 22 09:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:07:07.712496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4e9de-bfd6-4161-9b1f-ce5945cf260b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.713322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4e9de-bfd6-4161-9b1f-ce5945cf260b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.713685 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4e9de-bfd6-4161-9b1f-ce5945cf260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.734759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 814/1654] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:07 2022] DELETE /identity/v3/users/0566ccd565fd4a0a871a3644142debb0 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:07.736568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70b57-a983-46e3-b496-3561e8d07322 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.736942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70b57-a983-46e3-b496-3561e8d07322 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.737625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70b57-a983-46e3-b496-3561e8d07322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.760184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:07.767196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c1d4e9de-bfd6-4161-9b1f-ce5945cf260b None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:07.768835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c1d4e9de-bfd6-4161-9b1f-ce5945cf260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:07.799854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-eec70b57-a983-46e3-b496-3561e8d07322 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:07.799854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-eec70b57-a983-46e3-b496-3561e8d07322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:07.900517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 815/1655] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:07.939142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 841/1656] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 22 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:07.945494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d1fc-a7c5-4014-b7f6-57ba7b7de83d None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.945868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d1fc-a7c5-4014-b7f6-57ba7b7de83d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.946406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d1fc-a7c5-4014-b7f6-57ba7b7de83d None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.947915 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 816/1657] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 22 09:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:07.954229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:07.954525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:07.954813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:07.957766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d1fc-a7c5-4014-b7f6-57ba7b7de83d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:07.960028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1161d1fc-a7c5-4014-b7f6-57ba7b7de83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:08.237418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:08.237418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:08.237418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 842/1658] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:08.240563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d1fc-a7c5-4014-b7f6-57ba7b7de83d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:08.240563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:08.240563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:08.240563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:08.241382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:08.241382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:08.241705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:08.241705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:08.241705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:08.241705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:08.241705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 817/1659] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:08.242457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a823a-6d1e-41f6-a143-49291e3152e3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:08.242457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:08.242457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:08.242457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:08.243064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:08.243064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:08.243064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:08.271623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 843/1660] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:09.504893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:09.520781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6b590-0507-4d2e-9f2a-c232228e33ba service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:09.531949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:09.533076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:09.533492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:09.533960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:09.536532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:09.538262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:09.634649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:09.638227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:09.650500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 818/1661] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:09.972768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:09.974563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:10.019008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560894-9ae7-446c-8b06-9d1e65f60b7d service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:10.038421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:10.039427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:10.040987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:10.042917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] PATH_INFO: `/v3/projects/c86d072c3df9460895499d6fba56760c` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:10.044542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86d072c3df9460895499d6fba56760c)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:10.048322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:10.236524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86d072c3df9460895499d6fba56760c', 'request_id': 'req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.254739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86d072c3df9460895499d6fba56760c', 'request_id': 'req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.280820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86d072c3df9460895499d6fba56760c', 'request_id': 'req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.360465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:10.376787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] The token cache is being invalidate because project c86d072c3df9460895499d6fba56760c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:10.377080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.377854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.383191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 844/1662] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:09 2022] DELETE /identity/v3/projects/c86d072c3df9460895499d6fba56760c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:10.387240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:10.399121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213441f-bb8a-44c4-ac1b-368d59be41c7 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:10.529260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:10.530158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:10.530483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:10.531267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] PATH_INFO: `/v3/users/ef76042d819d4e9c99f13516cd9a8787` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:10.533235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef76042d819d4e9c99f13516cd9a8787)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:10.539658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:10.890182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef76042d819d4e9c99f13516cd9a8787'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.970976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef76042d819d4e9c99f13516cd9a8787'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.990151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef76042d819d4e9c99f13516cd9a8787'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.993264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef76042d819d4e9c99f13516cd9a8787'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:10.994739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef76042d819d4e9c99f13516cd9a8787'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:11.042363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 819/1663] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:10 2022] DELETE /identity/v3/users/ef76042d819d4e9c99f13516cd9a8787 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:13.656430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:13.658090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:13.683681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364a2f-c7b0-4ffe-9066-4a49bc5924b9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:13.840653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:13.841582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:13.843300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:13.843503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] PATH_INFO: `/v3/projects/b1934c157e0e4433ae95b41801819afa` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:13.849141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:13.849894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1934c157e0e4433ae95b41801819afa)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:13.854558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:13.855503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:13.888803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6dac3-d7e4-4e62-aad4-bdaaeef7da28 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:13.914353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:13.915552 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:13.917188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:13.917640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] PATH_INFO: `/v3/users/0e5efd0b9ce94f51998754c6eaa1cdcc` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:13.926316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5efd0b9ce94f51998754c6eaa1cdcc)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:13.930798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:14.002892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1934c157e0e4433ae95b41801819afa', 'request_id': 'req-3723397c-1344-4686-80b7-f77ff1b13e85'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.014193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1934c157e0e4433ae95b41801819afa', 'request_id': 'req-3723397c-1344-4686-80b7-f77ff1b13e85'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.029404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1934c157e0e4433ae95b41801819afa', 'request_id': 'req-3723397c-1344-4686-80b7-f77ff1b13e85'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.159713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] The token cache is being invalidate because project b1934c157e0e4433ae95b41801819afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:14.160235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.161404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3723397c-1344-4686-80b7-f77ff1b13e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.168865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 845/1664] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:13 2022] DELETE /identity/v3/projects/b1934c157e0e4433ae95b41801819afa => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:14.174330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca4988-ac3a-4168-a107-ef2f93371d80 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:14.174779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca4988-ac3a-4168-a107-ef2f93371d80 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:14.175212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca4988-ac3a-4168-a107-ef2f93371d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:14.219002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5efd0b9ce94f51998754c6eaa1cdcc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.222663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6cca4988-ac3a-4168-a107-ef2f93371d80 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:14.225480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6cca4988-ac3a-4168-a107-ef2f93371d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:14.247706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:14.297202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5efd0b9ce94f51998754c6eaa1cdcc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.305434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:14.313039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5efd0b9ce94f51998754c6eaa1cdcc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.314755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5efd0b9ce94f51998754c6eaa1cdcc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.316602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27983bfe-8474-4a3c-a635-f32c505111b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5efd0b9ce94f51998754c6eaa1cdcc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:14.373366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 820/1665] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:13 2022] DELETE /identity/v3/users/0e5efd0b9ce94f51998754c6eaa1cdcc => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:14.378584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:14.379118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:14.379548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:14.410042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:14.411548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:14.421656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 846/1666] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:14.423299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10a82b-3131-4347-b0a1-53b43f141dc2 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:14.423918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10a82b-3131-4347-b0a1-53b43f141dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:14.423918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10a82b-3131-4347-b0a1-53b43f141dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:14.482915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7a10a82b-3131-4347-b0a1-53b43f141dc2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:14.485562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7a10a82b-3131-4347-b0a1-53b43f141dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:14.565921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 821/1667] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:14.604704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:14.606166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:14.686190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 847/1668] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:14.689171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10a82b-3131-4347-b0a1-53b43f141dc2 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:14.715243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10a82b-3131-4347-b0a1-53b43f141dc2 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:14.727700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:14.731393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:14.732042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:14.736611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:14.736611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:14.736611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:14.740033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1c1fa-9d8c-49c0-a9d5-6d0d20c8a73f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:14.740268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:14.754896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:14.755890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:14.756344 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:14.757004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:14.771086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 848/1669] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:14.776433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:14.783867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:14.785426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:14.799706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 822/1670] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:14.811007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafff466-9f87-4be3-b33b-cf1de48356d2 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:14.828253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:14.829124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:14.829426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:14.829704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:14.830426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:14.837048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:14.942027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 849/1671] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:14 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:14.946773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:14.957805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a48ef-b5a6-40ac-8d55-bdc82372dccb service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:15.099416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:15.100418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.100815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.101201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.102245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:15.105266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:15.235827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 823/1672] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:14 2022] POST /identity/v3/users => generated 282 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:15.235984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:15.267216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f927e-ec91-4e41-b146-6ab4911fea79 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:15.281673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:15.282592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.282937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.283223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.283966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:15.286182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:15.314555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 850/1673] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:07:15.318114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:15.334162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3768fd-ae48-4405-b620-db2631f30b20 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:15.367970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661eef-871e-4681-8fe4-4cf5714a0089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:15.369026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661eef-871e-4681-8fe4-4cf5714a0089 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.369926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661eef-871e-4681-8fe4-4cf5714a0089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.370519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661eef-871e-4681-8fe4-4cf5714a0089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.371916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661eef-871e-4681-8fe4-4cf5714a0089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:15.384048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661eef-871e-4681-8fe4-4cf5714a0089 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:15.414384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:15.415626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 824/1674] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:15.429171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4ced-75eb-4d76-9b72-2fe6a2f150b3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:15.446137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:15.447577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.447866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.448243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] PATH_INFO: `/v3/projects/bc80c74b45c849c081b37b67e0aecb9e/users/9c00e2b4d57b4b3f83c9ad04029bf007/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.492125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc80c74b45c849c081b37b67e0aecb9e, user_id=9c00e2b4d57b4b3f83c9ad04029bf007, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:15.501147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:15.584115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 851/1675] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:15 2022] PUT /identity/v3/projects/bc80c74b45c849c081b37b67e0aecb9e/users/9c00e2b4d57b4b3f83c9ad04029bf007/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:15.584316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6e766-bad9-40d1-b97a-06dacc86f948 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.585037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6e766-bad9-40d1-b97a-06dacc86f948 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.585459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6e766-bad9-40d1-b97a-06dacc86f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.714058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2da6e766-bad9-40d1-b97a-06dacc86f948 None None] MFA Rules not processed for user `9c00e2b4d57b4b3f83c9ad04029bf007`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:15.716323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2da6e766-bad9-40d1-b97a-06dacc86f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:15.890593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:15.992790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 825/1676] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:15.994050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:16.126339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:16.192636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70416-88e4-4c1d-b75b-e928d7a2f719 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:16.214343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:16.215785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:16.216249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:16.217300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:16.219477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:16.222455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:16.420343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 852/1677] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:15 2022] POST /identity/v3/projects => generated 365 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:16.420796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6e766-bad9-40d1-b97a-06dacc86f948 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:16.443048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6e766-bad9-40d1-b97a-06dacc86f948 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:16.645396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:16.648746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:16.658491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caa0de-49bb-4a44-b2a6-e6f6dcbaa588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:16.659340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa0de-49bb-4a44-b2a6-e6f6dcbaa588 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:16.659630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa0de-49bb-4a44-b2a6-e6f6dcbaa588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:16.659939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa0de-49bb-4a44-b2a6-e6f6dcbaa588 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:16.660671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa0de-49bb-4a44-b2a6-e6f6dcbaa588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:16.662599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa0de-49bb-4a44-b2a6-e6f6dcbaa588 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:16.692906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292a2c3-8047-4284-8d6e-92b35f557773 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:16.712796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:16.756402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:16.756402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:16.756402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] PATH_INFO: `/v3/users/d3e65b6545344a8fa585ec4720bdafb6` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:16.756402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e65b6545344a8fa585ec4720bdafb6)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:16.756402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: WARNING py.warnings [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:07:16.756402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: warnings.warn(msg) Jun 22 09:07:16.756402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: Jun 22 09:07:16.758342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:16.862855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 826/1678] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:16 2022] POST /identity/v3/users => generated 289 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:16.866841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:16.867772 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:16.870748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:16.985782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] MFA Rules not processed for user `abcbf501ca754212a16bbfbb901944f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:16.988941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:17.110668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e65b6545344a8fa585ec4720bdafb6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.136086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e65b6545344a8fa585ec4720bdafb6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.137198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e65b6545344a8fa585ec4720bdafb6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.138660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e65b6545344a8fa585ec4720bdafb6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.163559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 827/1679] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:17.165542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:17.167649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:17.182368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e65b6545344a8fa585ec4720bdafb6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.207319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953d69-8893-4386-9f3f-7658eb19dea9 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:17.213064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:17.214540 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:17.215158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:17.222846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:17.222846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:17.226302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:17.284726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 828/1680] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:17.284726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:17.284726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:17.305097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 853/1681] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:16 2022] DELETE /identity/v3/users/d3e65b6545344a8fa585ec4720bdafb6 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:17.306788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:17.309652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:17.343231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30263fab-41fb-457d-b210-b2d0327b61f0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:17.547854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:17.550909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:17.551192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:17.555173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] PATH_INFO: `/v3/projects/a5f6cfeded344f279292678ce4edf36b` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:17.556643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f6cfeded344f279292678ce4edf36b)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:17.563848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: WARNING py.warnings [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:07:17.563848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: warnings.warn(msg) Jun 22 09:07:17.563848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: Jun 22 09:07:17.563848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:17.565616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6843-8370-4b9b-a68c-e7c0d5efb86c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:17.583729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:17.588204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:17.588204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:17.588204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:17.673531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:17.677324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:17.724861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:17.726850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:17.749950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 854/1682] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:17.751012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:17.752739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:17.831662 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f6cfeded344f279292678ce4edf36b', 'request_id': 'req-6de77b87-3e5d-4f2e-87b6-2f50153c4727'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.861256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f6cfeded344f279292678ce4edf36b', 'request_id': 'req-6de77b87-3e5d-4f2e-87b6-2f50153c4727'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.878557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f6cfeded344f279292678ce4edf36b', 'request_id': 'req-6de77b87-3e5d-4f2e-87b6-2f50153c4727'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.893185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b83713-eadc-4a08-b7ae-77886a9accc5 service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:17.959730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] The token cache is being invalidate because project a5f6cfeded344f279292678ce4edf36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:17.961717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.961717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.964171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 829/1683] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:17 2022] DELETE /identity/v3/projects/a5f6cfeded344f279292678ce4edf36b => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:17.972008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:17.975747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.031553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cc78-71ff-4cce-ab34-b8722b244a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.032645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cc78-71ff-4cce-ab34-b8722b244a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.033006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cc78-71ff-4cce-ab34-b8722b244a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.033358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cc78-71ff-4cce-ab34-b8722b244a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.035736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5233cc78-71ff-4cce-ab34-b8722b244a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.141850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de77b87-3e5d-4f2e-87b6-2f50153c4727 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:18.151656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cc78-71ff-4cce-ab34-b8722b244a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.152830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cc78-71ff-4cce-ab34-b8722b244a44 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:18.158380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.159443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.159827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.160195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] PATH_INFO: `/v3/projects/b650a9523f9d4914a8359c0c4f27e2c8/users/6222e113bf7448f9ba6097a84469797e/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.177388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 855/1684] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:18.179361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.179651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.179961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.197386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b650a9523f9d4914a8359c0c4f27e2c8, user_id=6222e113bf7448f9ba6097a84469797e, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.204619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:18.220112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:18.225676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.247502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 856/1685] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:18.248537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:18.258365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.296583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b55d69-691a-425e-aa84-82f000e2872d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:18.312153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.312153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.312153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.312153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] PATH_INFO: `/v3/users/3d47ec38b42b4a7cb8a0eed889c8dc80` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.313704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d47ec38b42b4a7cb8a0eed889c8dc80)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.319824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:18.341563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 830/1686] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:17 2022] PUT /identity/v3/projects/b650a9523f9d4914a8359c0c4f27e2c8/users/6222e113bf7448f9ba6097a84469797e/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:18.342960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:18.355761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.384395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:18.619103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d47ec38b42b4a7cb8a0eed889c8dc80'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.647217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d47ec38b42b4a7cb8a0eed889c8dc80'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.647999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d47ec38b42b4a7cb8a0eed889c8dc80'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.648657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d47ec38b42b4a7cb8a0eed889c8dc80'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.690892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d47ec38b42b4a7cb8a0eed889c8dc80'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.790048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a6358-2e66-4a88-aec0-2b53480bc35c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:18.802671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c949e-a4e8-40fd-bd09-653edad2266d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.809447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c949e-a4e8-40fd-bd09-653edad2266d service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.809447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c949e-a4e8-40fd-bd09-653edad2266d service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.809447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c949e-a4e8-40fd-bd09-653edad2266d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.809698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 857/1687] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:18 2022] DELETE /identity/v3/users/3d47ec38b42b4a7cb8a0eed889c8dc80 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:18.809698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:18.811454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.813599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ea5c949e-a4e8-40fd-bd09-653edad2266d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.932451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:18.962541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c949e-a4e8-40fd-bd09-653edad2266d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.966000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c949e-a4e8-40fd-bd09-653edad2266d service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:18.975294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4a244-f799-4514-ba8d-b42dde10a5c2 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:18.992495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 831/1688] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:18.995354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.996096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.996285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4eeca-22f8-41ba-9005-03f4a66b68f6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.996423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.996665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.997010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4eeca-22f8-41ba-9005-03f4a66b68f6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.997577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.998148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4eeca-22f8-41ba-9005-03f4a66b68f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.000818 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.025368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 858/1689] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:19.028576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.051620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f125b-3a8e-48c1-b90c-09dd14af0892 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.062085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7472c1-6613-42ac-af1e-c04ea0dab985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.063032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7472c1-6613-42ac-af1e-c04ea0dab985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.063312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7472c1-6613-42ac-af1e-c04ea0dab985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.063588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7472c1-6613-42ac-af1e-c04ea0dab985 admin admin] PATH_INFO: `/v3/projects/b650a9523f9d4914a8359c0c4f27e2c8/users/6222e113bf7448f9ba6097a84469797e/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.071794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7472c1-6613-42ac-af1e-c04ea0dab985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b650a9523f9d4914a8359c0c4f27e2c8, user_id=6222e113bf7448f9ba6097a84469797e, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.074482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7472c1-6613-42ac-af1e-c04ea0dab985 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.083062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3fd4eeca-22f8-41ba-9005-03f4a66b68f6 None None] MFA Rules not processed for user `0673a8903f56430f86f87b9447668300`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:19.086104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3fd4eeca-22f8-41ba-9005-03f4a66b68f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.097246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 859/1690] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:19 2022] PUT /identity/v3/projects/b650a9523f9d4914a8359c0c4f27e2c8/users/6222e113bf7448f9ba6097a84469797e/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:19.102054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.104898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.105466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.174497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] MFA Rules not processed for user `71ac6423996b4e5d906de9ff6986fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:19.176439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.259357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 832/1691] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:19.266297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef345d-cfe1-447c-a531-2edaef293f74 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.266297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef345d-cfe1-447c-a531-2edaef293f74 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.266297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef345d-cfe1-447c-a531-2edaef293f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.343779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a0ef345d-cfe1-447c-a531-2edaef293f74 None None] MFA Rules not processed for user `6222e113bf7448f9ba6097a84469797e`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:19.348523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a0ef345d-cfe1-447c-a531-2edaef293f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.384347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 860/1692] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:19.399171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.420026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.624617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 833/1693] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:19.626375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.626678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.629240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.674634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] MFA Rules not processed for user `71ac6423996b4e5d906de9ff6986fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:19.682054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.684908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba373-08a6-4428-bcc9-19bc14054313 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.694488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.695385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.696103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.696103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.706399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.712906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 834/1694] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:19.712906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.713149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.713223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.737013 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 861/1695] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:19.737987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.739619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.757296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1d962-c72d-4fe2-9670-4e0d0f860ef8 service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.764029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.765343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.765692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.766072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.794319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.796370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.810675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 862/1696] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:19.899034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c556c-436b-4816-a3ab-7f8eed63232e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.909594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.910274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.910559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.910857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.931639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.933106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.955724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 835/1697] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:20.089678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:20.091251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:20.253206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3dca7-3c47-4c6c-a941-d30a835e8d9f service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:20.287640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:20.293676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:20.295600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:20.298006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] PATH_INFO: `/v3/projects/e45cee7cefba4c77a5f2f97769686105` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:20.303872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45cee7cefba4c77a5f2f97769686105)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:20.311957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:20.444842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:20.501808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:20.615672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45cee7cefba4c77a5f2f97769686105', 'request_id': 'req-f19dad35-6e0d-4cff-b716-6bc6eac000a7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:20.653773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45cee7cefba4c77a5f2f97769686105', 'request_id': 'req-f19dad35-6e0d-4cff-b716-6bc6eac000a7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:20.671778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45cee7cefba4c77a5f2f97769686105', 'request_id': 'req-f19dad35-6e0d-4cff-b716-6bc6eac000a7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:20.691466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:20.691466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:20.726766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5e6be-959d-4770-a215-0f14790000f0 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:20.773352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] The token cache is being invalidate because project e45cee7cefba4c77a5f2f97769686105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:20.779249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:20.779249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f19dad35-6e0d-4cff-b716-6bc6eac000a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:20.779249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 863/1698] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:20 2022] DELETE /identity/v3/projects/e45cee7cefba4c77a5f2f97769686105 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:20.789088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f404242-54a7-4913-baeb-b3f3ec2fe271 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:20.789697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f404242-54a7-4913-baeb-b3f3ec2fe271 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:20.791456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f404242-54a7-4913-baeb-b3f3ec2fe271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:20.829264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7f404242-54a7-4913-baeb-b3f3ec2fe271 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:20.831231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7f404242-54a7-4913-baeb-b3f3ec2fe271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:20.838986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:20.846607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 864/1699] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:20.855310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4389684-2bdc-451c-b07e-172e99f08c26 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:20.855310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4389684-2bdc-451c-b07e-172e99f08c26 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:20.855648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4389684-2bdc-451c-b07e-172e99f08c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:20.859032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:20.859608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:20.860047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] PATH_INFO: `/v3/projects/2fa9985ff7ec48a6ab12c4e5070359de` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:20.862630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa9985ff7ec48a6ab12c4e5070359de)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:20.870494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:20.929677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e4389684-2bdc-451c-b07e-172e99f08c26 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:20.933587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e4389684-2bdc-451c-b07e-172e99f08c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:20.958429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 865/1700] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:20.958429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4f4c-4462-4887-93cc-ce268ddcf119 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:20.958429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4f4c-4462-4887-93cc-ce268ddcf119 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:20.958429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac4f4c-4462-4887-93cc-ce268ddcf119 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:20.959473 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 866/1701] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 22 09:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:20.960784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4f4c-4462-4887-93cc-ce268ddcf119 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:20.981321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac4f4c-4462-4887-93cc-ce268ddcf119 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:20.989304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d7ff3-89e4-49b0-8371-179f7d83e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:20.991406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d7ff3-89e4-49b0-8371-179f7d83e39e admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:20.992123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d7ff3-89e4-49b0-8371-179f7d83e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:20.993591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d7ff3-89e4-49b0-8371-179f7d83e39e admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:20.994651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d7ff3-89e4-49b0-8371-179f7d83e39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:20.995359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d7ff3-89e4-49b0-8371-179f7d83e39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:20.997490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d7ff3-89e4-49b0-8371-179f7d83e39e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:21.036137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 867/1702] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:21.043975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfd72a-d3ff-41b4-8eee-792ee1bdeab7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:21.043975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfd72a-d3ff-41b4-8eee-792ee1bdeab7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:21.043975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfd72a-d3ff-41b4-8eee-792ee1bdeab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:21.120051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-51dfd72a-d3ff-41b4-8eee-792ee1bdeab7 None None] MFA Rules not processed for user `c6bbb0e4d7ca44fc8cb68fdc96260caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:21.123548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-51dfd72a-d3ff-41b4-8eee-792ee1bdeab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.160881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa9985ff7ec48a6ab12c4e5070359de', 'request_id': 'req-504ac619-7dde-417f-8593-f0849457ccd1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:21.185421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa9985ff7ec48a6ab12c4e5070359de', 'request_id': 'req-504ac619-7dde-417f-8593-f0849457ccd1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:21.209694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa9985ff7ec48a6ab12c4e5070359de', 'request_id': 'req-504ac619-7dde-417f-8593-f0849457ccd1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:21.244648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 868/1703] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:21.249271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:21.249615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:21.250079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:21.281629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] MFA Rules not processed for user `0a8cc558dee74179b538f20c1b90f44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:21.283791 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.366315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] The token cache is being invalidate because project 2fa9985ff7ec48a6ab12c4e5070359de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:21.367175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:21.370654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:21.372879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 836/1704] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:20 2022] DELETE /identity/v3/projects/2fa9985ff7ec48a6ab12c4e5070359de => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:21.373928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:21.383728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.424645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:21.442398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 869/1705] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:21.445473 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:21.461664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.478179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a45d5-8241-4d74-b4ed-dd3da56de0f4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:21.483010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e7326-6e63-4850-ba91-ef15bd13964a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:21.484173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7326-6e63-4850-ba91-ef15bd13964a service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:21.484458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7326-6e63-4850-ba91-ef15bd13964a service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:21.484735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7326-6e63-4850-ba91-ef15bd13964a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:21.488211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9d8e7326-6e63-4850-ba91-ef15bd13964a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.500926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e7326-6e63-4850-ba91-ef15bd13964a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:21.503129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e7326-6e63-4850-ba91-ef15bd13964a service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:21.516095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 870/1706] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:21.518227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77778-92ec-4aa1-8130-10d417e0c1b9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:21.518662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77778-92ec-4aa1-8130-10d417e0c1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:21.519087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77778-92ec-4aa1-8130-10d417e0c1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:21.540501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac619-7dde-417f-8593-f0849457ccd1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:21.544706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9ca77778-92ec-4aa1-8130-10d417e0c1b9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:21.546761 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9ca77778-92ec-4aa1-8130-10d417e0c1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.552393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:21.554683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:21.554683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:21.554683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:21.557776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 871/1707] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:21.559426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967566b-42c2-4502-97b3-72d06cbe0821 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:21.559985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967566b-42c2-4502-97b3-72d06cbe0821 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:21.560419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967566b-42c2-4502-97b3-72d06cbe0821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:21.562377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:21.570576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:21.615809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5967566b-42c2-4502-97b3-72d06cbe0821 None None] MFA Rules not processed for user `0a8cc558dee74179b538f20c1b90f44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:21.643416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5967566b-42c2-4502-97b3-72d06cbe0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.675300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 872/1708] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:21.677066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:21.677511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:21.677798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:21.748928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:21.759307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.781778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 873/1709] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:21.787884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:21.796634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:21.867581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 837/1710] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:21 2022] POST /identity/v3/projects => generated 363 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:21.873062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:21.994750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb6f48-ecb4-49eb-8348-88df8a392e30 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:22.007557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07aa0cd-1e33-4dde-bb7c-e0f4832d30d3 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:22.015269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:22.016292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.016918 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.017390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.018626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:22.019257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:22.021741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:22.041244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 838/1711] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:22.043614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:22.064470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb9c16-89ac-43e8-bcbf-6184e0b83fed admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:22.076536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:22.078704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.081495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.081996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.083555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:22.089521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:22.182778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 839/1712] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:22 2022] POST /identity/v3/users => generated 282 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:22.182778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:22.189415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:22.206058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:22.207954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.208916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.209212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.223441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f712-5482-4760-a34f-6669899a8c9c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:22.232154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:22.249277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.249277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.249277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] PATH_INFO: `/v3/users/9c00e2b4d57b4b3f83c9ad04029bf007` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.249277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c00e2b4d57b4b3f83c9ad04029bf007)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:22.249277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:22.362544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:22.362544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:22.394741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 874/1713] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:22.409977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:22.444000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fd2d-c9f1-4778-8a22-d4f62b7e1b8d service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:22.456784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:22.457429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.457716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.457992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.458688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:22.467165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:22.497946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c00e2b4d57b4b3f83c9ad04029bf007'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:22.619163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 875/1714] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:22 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:22.620657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:22.667088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c00e2b4d57b4b3f83c9ad04029bf007'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:22.685414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c00e2b4d57b4b3f83c9ad04029bf007'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:22.687009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c00e2b4d57b4b3f83c9ad04029bf007'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:22.688499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c00e2b4d57b4b3f83c9ad04029bf007'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:22.734532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 840/1715] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:22 2022] DELETE /identity/v3/users/9c00e2b4d57b4b3f83c9ad04029bf007 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:22.735411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:22.741152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:22.796226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247449a-7a8a-4576-b7eb-99d5a8bda3a0 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:22.873290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef541a6-5790-4e9d-a470-d9f4560328a5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:22.878973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1377ae1-1820-4367-9f3d-852a14457445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:22.879668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377ae1-1820-4367-9f3d-852a14457445 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.879956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377ae1-1820-4367-9f3d-852a14457445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.880239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377ae1-1820-4367-9f3d-852a14457445 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.880942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1377ae1-1820-4367-9f3d-852a14457445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:22.883219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1377ae1-1820-4367-9f3d-852a14457445 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:22.924629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd4bf-e501-40fa-bc45-a48e5279a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:22.925670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd4bf-e501-40fa-bc45-a48e5279a329 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.925670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd4bf-e501-40fa-bc45-a48e5279a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.927758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd4bf-e501-40fa-bc45-a48e5279a329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.930229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd4bf-e501-40fa-bc45-a48e5279a329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:22.932810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd4bf-e501-40fa-bc45-a48e5279a329 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:22.959509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 876/1716] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:22.961099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9f227-2fb2-4657-8ebb-bf9a697fb9ee None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.963007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9f227-2fb2-4657-8ebb-bf9a697fb9ee None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.964050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9f227-2fb2-4657-8ebb-bf9a697fb9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.992584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 841/1717] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:22 2022] POST /identity/v3/users => generated 300 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:22.994417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61975-9b9f-4016-bcfd-c95658d49f62 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:22.994920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61975-9b9f-4016-bcfd-c95658d49f62 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:22.995399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61975-9b9f-4016-bcfd-c95658d49f62 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:22.997939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 842/1718] 10.222.0.55 () {54 vars in 960 bytes} [Wed Jun 22 09:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:22.999032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d61975-9b9f-4016-bcfd-c95658d49f62 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:23.001038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-21d61975-9b9f-4016-bcfd-c95658d49f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:23.012220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-37b9f227-2fb2-4657-8ebb-bf9a697fb9ee None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:23.029329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-37b9f227-2fb2-4657-8ebb-bf9a697fb9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:23.030943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d61975-9b9f-4016-bcfd-c95658d49f62 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:23.040988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e023e0e-b13a-4349-b5cc-bf2add8a042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:23.041947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e023e0e-b13a-4349-b5cc-bf2add8a042b admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.043616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e023e0e-b13a-4349-b5cc-bf2add8a042b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.044023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e023e0e-b13a-4349-b5cc-bf2add8a042b admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.045029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e023e0e-b13a-4349-b5cc-bf2add8a042b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:23.048157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e023e0e-b13a-4349-b5cc-bf2add8a042b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:23.061609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 877/1719] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:23.062871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9f227-2fb2-4657-8ebb-bf9a697fb9ee None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:23.075991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 843/1720] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:23.078727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebcad2-55aa-41e3-b046-0cab99fe97e6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.083135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebcad2-55aa-41e3-b046-0cab99fe97e6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.083551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebcad2-55aa-41e3-b046-0cab99fe97e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.090864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:23.104462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9f227-2fb2-4657-8ebb-bf9a697fb9ee None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:23.117052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb6d99-a894-4eba-a726-3b827f58d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:23.119953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb6d99-a894-4eba-a726-3b827f58d33c admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.120424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb6d99-a894-4eba-a726-3b827f58d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.120845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb6d99-a894-4eba-a726-3b827f58d33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.122585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb6d99-a894-4eba-a726-3b827f58d33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:23.133653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb6d99-a894-4eba-a726-3b827f58d33c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:23.141813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a2ebcad2-55aa-41e3-b046-0cab99fe97e6 None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:23.147107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a2ebcad2-55aa-41e3-b046-0cab99fe97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:23.161619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 878/1721] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:23.166979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.174893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.175770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.248837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] MFA Rules not processed for user `71ac6423996b4e5d906de9ff6986fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:23.250683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:23.303887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 844/1722] 10.222.0.55 () {58 vars in 1057 bytes} [Wed Jun 22 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:23.305272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebcad2-55aa-41e3-b046-0cab99fe97e6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:23.321578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebcad2-55aa-41e3-b046-0cab99fe97e6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:23.329629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:23.330952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.332043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.347791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] PATH_INFO: `/v3/projects/542849edf35348f3a0c3617faf77d809/users/ac6eab264acd498ea06cfa8315a41ec1/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.361254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 879/1723] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:23.361254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:23.370651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:23.420034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542849edf35348f3a0c3617faf77d809, user_id=ac6eab264acd498ea06cfa8315a41ec1, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:23.426017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:23.540531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 845/1724] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:23 2022] PUT /identity/v3/projects/542849edf35348f3a0c3617faf77d809/users/ac6eab264acd498ea06cfa8315a41ec1/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:23.541386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:23.579555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ef46-b342-4a85-a157-3e831a4c23d9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:23.780829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb3dd-d680-4644-a3e0-f344b2ce66d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:23.783033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb3dd-d680-4644-a3e0-f344b2ce66d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.783786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb3dd-d680-4644-a3e0-f344b2ce66d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.784520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb3dd-d680-4644-a3e0-f344b2ce66d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.788408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531322f-9a03-40f9-ba5e-c354ec58cd55 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:23.799019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:23.799387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.799677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.800158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.807858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:23.811576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:23.827781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb3dd-d680-4644-a3e0-f344b2ce66d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:23.838546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb3dd-d680-4644-a3e0-f344b2ce66d5 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:23.839881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 846/1725] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:23.860798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:23.885318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 880/1726] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:23.890540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562949-0c42-4d33-b1eb-ebc0adfc2cb9 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.894040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562949-0c42-4d33-b1eb-ebc0adfc2cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.894040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562949-0c42-4d33-b1eb-ebc0adfc2cb9 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.900496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 881/1727] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 22 09:07:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:23.903757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed8102-74f7-49f2-8fb3-dcf64d2e694c None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:23.904048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed8102-74f7-49f2-8fb3-dcf64d2e694c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:23.904331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed8102-74f7-49f2-8fb3-dcf64d2e694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:23.981267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-63ed8102-74f7-49f2-8fb3-dcf64d2e694c None None] MFA Rules not processed for user `ac6eab264acd498ea06cfa8315a41ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:23.982602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-63ed8102-74f7-49f2-8fb3-dcf64d2e694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:24.012582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a610-870d-48de-b15f-920c29a27f46 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:24.026415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:24.027392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.027840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.028196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.040253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:24.064767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:24.067582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:24.084957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 847/1728] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:24.085881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:24.099872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0903-6584-4359-989c-3efe00e19881 service placement] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:24.105970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:24.106926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.107661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.108543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] PATH_INFO: `/v3/projects/a344884cd14648f6ab96d4662d3dc893/users/3a737cb85e72476b8a10dd52382e25af/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.164691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:24.166597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a344884cd14648f6ab96d4662d3dc893, user_id=3a737cb85e72476b8a10dd52382e25af, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:24.177670 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:24.194697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 882/1729] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:24.199493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.202580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.202898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.233706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] MFA Rules not processed for user `c6bbb0e4d7ca44fc8cb68fdc96260caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:24.235102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:24.251899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 883/1730] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:07:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:24.253203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:24.254923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:24.278314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc730cda-3335-4c5d-a962-5ef35471496b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:24.285055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:24.286263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.287114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.294510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] PATH_INFO: `/v3/users/7fc7afbfc06e497ab51be591b95cc42a` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.310942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 848/1731] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:24 2022] PUT /identity/v3/projects/a344884cd14648f6ab96d4662d3dc893/users/3a737cb85e72476b8a10dd52382e25af/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:24.310942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:24.316877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc7afbfc06e497ab51be591b95cc42a)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:24.323669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:24.495740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89e72f-5e1e-4c12-953d-9133dcab9a33 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:24.502814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:24.503704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.503995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.504323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.505590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:24.507612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:24.611524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc7afbfc06e497ab51be591b95cc42a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.621622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 849/1732] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:24 2022] POST /identity/v3/projects => generated 365 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:24.622892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:24.629707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc7afbfc06e497ab51be591b95cc42a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.631311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc7afbfc06e497ab51be591b95cc42a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.632742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc7afbfc06e497ab51be591b95cc42a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.670427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-96cbcd56-fe07-4c30-970a-ad22a35e55fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc7afbfc06e497ab51be591b95cc42a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.757528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 884/1733] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:24 2022] DELETE /identity/v3/users/7fc7afbfc06e497ab51be591b95cc42a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:24.759208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b484-291a-4c45-89e2-d42d6781fa0d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.759612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b484-291a-4c45-89e2-d42d6781fa0d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.759914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9b484-291a-4c45-89e2-d42d6781fa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.798292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2059d8-2c45-4212-8cfe-58aa2dcb1376 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:24.860909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-11b9b484-291a-4c45-89e2-d42d6781fa0d None None] MFA Rules not processed for user `3a737cb85e72476b8a10dd52382e25af`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:24.864605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-11b9b484-291a-4c45-89e2-d42d6781fa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:24.956561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:24.960312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.960599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.960908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.976106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:25.036914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.041119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.075134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 850/1734] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:25.077206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.081551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:25.129128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 885/1735] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:25.130697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.131025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.137911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.229678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:25.250640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:25.382452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:25.384209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96979fd6-75aa-4ed6-91da-8486fc454a2f service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:25.417301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:25.423141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.424462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.428905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.431355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.439835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.498203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 886/1736] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:25.500451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.504956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:25.525577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0cbc7-ae1d-4f86-bd62-68a7b6d92136 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:25.538945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:25.544199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.546011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.546373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.548933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.554142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.559819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 851/1737] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:25 2022] POST /identity/v3/users => generated 289 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:25.562218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.563824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:25.596763 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd823e-1ede-45ac-812e-2b28031b868b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:25.611694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:25.612741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.613158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.613570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.637688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.643357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.671959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 852/1738] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:25.672825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.694203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e983e-dc63-44a2-bac5-0e9a2a4f89a0 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:25.708436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:25.709126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.709418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.709693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.710436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.712093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.738101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 853/1739] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:25.743263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.768418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4a9f0-25a5-4a46-ab6b-6b06baf780d2 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:25.772246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 887/1740] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:25 2022] POST /identity/v3/projects => generated 401 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:25.774759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.925065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:25.925065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.925065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.925065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] PATH_INFO: `/v3/projects/428543e27d04489e92aa2b17ebbde3c9/users/f3ae32635e0a43c691789b8f894b454f/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.947520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428543e27d04489e92aa2b17ebbde3c9, user_id=f3ae32635e0a43c691789b8f894b454f, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.955301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.992154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a1b59-8692-48d3-be0f-dc7b64e7d15e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:26.010620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:26.011548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.012435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.012435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.013127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:26.019647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:26.125912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 854/1741] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:25 2022] PUT /identity/v3/projects/428543e27d04489e92aa2b17ebbde3c9/users/f3ae32635e0a43c691789b8f894b454f/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:26.136313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:26.155506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:26.161875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 888/1742] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:25 2022] POST /identity/v3/users => generated 307 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:26.162529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:26.165969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:26.213736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c619-352e-45a8-bdcf-8284e5c3fd19 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:26.343011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1f490-a77c-44fb-a20f-195198bec2f6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:26.362407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:26.363143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.363440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.363713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.364521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:26.367674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:26.384221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:26.385440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.385903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.386339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] PATH_INFO: `/v3/projects/bc80c74b45c849c081b37b67e0aecb9e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.395455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc80c74b45c849c081b37b67e0aecb9e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:26.397627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:26.406648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 855/1743] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:26.415290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:26.454394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a944-dd4f-46d1-98d3-1c5b04c0fa48 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:26.461601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:26.463191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.463671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.464306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.465522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:26.469184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:26.488261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 856/1744] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:26.489530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:26.525621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2d267-132d-4fc2-baf2-9d39c5af2dbc admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:26.544938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:26.556341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac239fa-bccf-459b-9c4a-7600750e30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:26.559676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac239fa-bccf-459b-9c4a-7600750e30ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.560038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac239fa-bccf-459b-9c4a-7600750e30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.560328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac239fa-bccf-459b-9c4a-7600750e30ef admin admin] PATH_INFO: `/v3/projects/428543e27d04489e92aa2b17ebbde3c9/users/f3ae32635e0a43c691789b8f894b454f/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.573409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac239fa-bccf-459b-9c4a-7600750e30ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=428543e27d04489e92aa2b17ebbde3c9, user_id=f3ae32635e0a43c691789b8f894b454f, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:26.591679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac239fa-bccf-459b-9c4a-7600750e30ef admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:26.629153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 857/1745] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:26 2022] PUT /identity/v3/projects/428543e27d04489e92aa2b17ebbde3c9/users/f3ae32635e0a43c691789b8f894b454f/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:26.631914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fd4c9-6b9a-42d1-8475-42dea77f9199 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.633499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fd4c9-6b9a-42d1-8475-42dea77f9199 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.634019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fd4c9-6b9a-42d1-8475-42dea77f9199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.634162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc80c74b45c849c081b37b67e0aecb9e', 'request_id': 'req-381e169a-2588-4ca4-a9b2-42720b70e532'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.655846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc80c74b45c849c081b37b67e0aecb9e', 'request_id': 'req-381e169a-2588-4ca4-a9b2-42720b70e532'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.670547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-949fd4c9-6b9a-42d1-8475-42dea77f9199 None None] MFA Rules not processed for user `abcbf501ca754212a16bbfbb901944f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:26.672542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-949fd4c9-6b9a-42d1-8475-42dea77f9199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:26.680070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc80c74b45c849c081b37b67e0aecb9e', 'request_id': 'req-381e169a-2588-4ca4-a9b2-42720b70e532'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.745566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 858/1746] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:26.746864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fd4c9-6b9a-42d1-8475-42dea77f9199 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:26.820611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] The token cache is being invalidate because project bc80c74b45c849c081b37b67e0aecb9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:26.820611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.824650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-381e169a-2588-4ca4-a9b2-42720b70e532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.826346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 889/1747] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:26 2022] DELETE /identity/v3/projects/bc80c74b45c849c081b37b67e0aecb9e => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:26.830429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.832192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.832192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.888576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] MFA Rules not processed for user `f3ae32635e0a43c691789b8f894b454f`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:26.891053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:26.906029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fd4c9-6b9a-42d1-8475-42dea77f9199 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:26.921555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:26.924794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.930072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.930072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] PATH_INFO: `/v3/projects/3a855ee6801c44609d46b94721071f0d/users/66a4202908e948ceb7269c3052587658/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.975554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a855ee6801c44609d46b94721071f0d, user_id=66a4202908e948ceb7269c3052587658, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:26.986514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:27.085514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 890/1748] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:27.086608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:27.089274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:27.136784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 859/1749] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:26 2022] PUT /identity/v3/projects/3a855ee6801c44609d46b94721071f0d/users/66a4202908e948ceb7269c3052587658/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:27.136784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:27.155005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:27.155914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20e9a6-05af-435c-92e3-921364726a32 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:27.374950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:27.376077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:27.376521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:27.376947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] PATH_INFO: `/v3/users/6222e113bf7448f9ba6097a84469797e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:27.378505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6222e113bf7448f9ba6097a84469797e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:27.381404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:27.385121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d004536-f7b7-4191-a037-36e914214b90 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:27.398019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:27.398838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:27.399236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:27.399639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:27.530866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:27.532746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:27.555952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 860/1750] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:27.557014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:27.563129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:27.600469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8783e-88d0-4037-a77a-f12b4357adc4 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:27.606604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:27.607242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:27.608341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:27.608775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:27.609601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:27.611842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:27.631582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 861/1751] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:27.631582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:27.642576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572d952-f127-459e-ac7d-96ae3ce3cebc admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:27.649184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41480e-52a4-4d5a-9d54-f95b1fa21d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:27.650517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41480e-52a4-4d5a-9d54-f95b1fa21d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:27.650937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41480e-52a4-4d5a-9d54-f95b1fa21d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:27.651314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41480e-52a4-4d5a-9d54-f95b1fa21d5b admin admin] PATH_INFO: `/v3/projects/3a855ee6801c44609d46b94721071f0d/users/66a4202908e948ceb7269c3052587658/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:27.653640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41480e-52a4-4d5a-9d54-f95b1fa21d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a855ee6801c44609d46b94721071f0d, user_id=66a4202908e948ceb7269c3052587658, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:27.660978 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41480e-52a4-4d5a-9d54-f95b1fa21d5b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:27.679658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 862/1752] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:27 2022] PUT /identity/v3/projects/3a855ee6801c44609d46b94721071f0d/users/66a4202908e948ceb7269c3052587658/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:27.691418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:27.695008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:27.695008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:27.709951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6222e113bf7448f9ba6097a84469797e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:27.751004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6222e113bf7448f9ba6097a84469797e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:27.757792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6222e113bf7448f9ba6097a84469797e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:27.757792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6222e113bf7448f9ba6097a84469797e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:27.789223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6222e113bf7448f9ba6097a84469797e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:27.799701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] MFA Rules not processed for user `66a4202908e948ceb7269c3052587658`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:27.803789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:27.851961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:27.902029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 891/1753] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:27 2022] DELETE /identity/v3/users/6222e113bf7448f9ba6097a84469797e => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:27.902029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:27.913179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:27.965676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 863/1754] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:27.965676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:27.966321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:28.095479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4f327-c2dd-4d61-8b85-75499329f827 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:28.101075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee570-7e2a-4b9b-8b7e-d97b5748d3dc None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:28.114204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:28.115229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:28.115584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:28.115933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] PATH_INFO: `/v3/projects/0159f3d4e6f34f22be2fc41642fc3e29` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:28.117364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0159f3d4e6f34f22be2fc41642fc3e29)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:28.119434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:28.197316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:28.198636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:28.198636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:28.199457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:28.202107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:28.276038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0159f3d4e6f34f22be2fc41642fc3e29', 'request_id': 'req-37a7dae1-4113-4e56-add9-dd3bb70c54ca'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:28.291998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0159f3d4e6f34f22be2fc41642fc3e29', 'request_id': 'req-37a7dae1-4113-4e56-add9-dd3bb70c54ca'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:28.303234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0159f3d4e6f34f22be2fc41642fc3e29', 'request_id': 'req-37a7dae1-4113-4e56-add9-dd3bb70c54ca'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:28.326048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:28.328650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:28.340257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 864/1755] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:28.341551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:28.343743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:28.369561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89264fd9-009e-4810-897d-0989c8762cbb service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:28.445686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] The token cache is being invalidate because project 0159f3d4e6f34f22be2fc41642fc3e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:28.446036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:28.449772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-37a7dae1-4113-4e56-add9-dd3bb70c54ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:28.455898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 892/1756] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:27 2022] DELETE /identity/v3/projects/0159f3d4e6f34f22be2fc41642fc3e29 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:28.455898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:28.456307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:28.456767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:28.516243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] MFA Rules not processed for user `0673a8903f56430f86f87b9447668300`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:28.523846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:28.565597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:28.605682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:28.607236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:28.608027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:28.609797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:28.616093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:28.778938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 893/1757] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:28.783190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:28.787708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:28.948733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:28.950773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:28.960433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ea5fc-3811-4b5f-9600-dce336eeedad None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:28.978342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 865/1758] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:28.991237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:28.991237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:29.000058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:29.004762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.007135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.011773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] PATH_INFO: `/v3/users/7c42ebe41fea498abf8fd6d6bba2912d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.020305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:29.020391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c42ebe41fea498abf8fd6d6bba2912d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:29.032411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:29.041312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4e9f-0b2c-4272-bed1-09214e4c83c7 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:29.053176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:29.055297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.055619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.055869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] PATH_INFO: `/v3/projects/b650a9523f9d4914a8359c0c4f27e2c8` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.059554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b650a9523f9d4914a8359c0c4f27e2c8)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:29.065735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:29.342192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b650a9523f9d4914a8359c0c4f27e2c8', 'request_id': 'req-a02e9750-7a0d-4abb-9dac-4d234175a4ab'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.356672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c42ebe41fea498abf8fd6d6bba2912d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.365938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b650a9523f9d4914a8359c0c4f27e2c8', 'request_id': 'req-a02e9750-7a0d-4abb-9dac-4d234175a4ab'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.374086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b650a9523f9d4914a8359c0c4f27e2c8', 'request_id': 'req-a02e9750-7a0d-4abb-9dac-4d234175a4ab'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.375961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c42ebe41fea498abf8fd6d6bba2912d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.376744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c42ebe41fea498abf8fd6d6bba2912d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.377524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c42ebe41fea498abf8fd6d6bba2912d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.406641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6fc559c2-1d42-4dc7-a904-98a0163152f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c42ebe41fea498abf8fd6d6bba2912d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.475311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] The token cache is being invalidate because project b650a9523f9d4914a8359c0c4f27e2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:29.476810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.477248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.480194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 866/1759] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:28 2022] DELETE /identity/v3/projects/b650a9523f9d4914a8359c0c4f27e2c8 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:29.481407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:29.486113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:29.527024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 894/1760] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:28 2022] DELETE /identity/v3/users/7c42ebe41fea498abf8fd6d6bba2912d => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:29.547600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd524a0-986d-4c61-8445-a371559248e3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.547910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd524a0-986d-4c61-8445-a371559248e3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.551582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd524a0-986d-4c61-8445-a371559248e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.642451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e9750-7a0d-4abb-9dac-4d234175a4ab admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:29.643944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-bdd524a0-986d-4c61-8445-a371559248e3 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:29.645195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bdd524a0-986d-4c61-8445-a371559248e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:29.753860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45b87d-c199-4b0a-80ba-aca36fb45300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:29.755156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b87d-c199-4b0a-80ba-aca36fb45300 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.767832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b87d-c199-4b0a-80ba-aca36fb45300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.769989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45b87d-c199-4b0a-80ba-aca36fb45300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.772727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fe45b87d-c199-4b0a-80ba-aca36fb45300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:29.841571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 895/1761] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:29.843571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a538f-03e9-4bf6-8952-ee0edf5f3742 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.843872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a538f-03e9-4bf6-8952-ee0edf5f3742 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.844155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a538f-03e9-4bf6-8952-ee0edf5f3742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.891485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0f0a538f-03e9-4bf6-8952-ee0edf5f3742 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:29.900298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0f0a538f-03e9-4bf6-8952-ee0edf5f3742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:29.919835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 896/1762] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:29.923936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a538f-03e9-4bf6-8952-ee0edf5f3742 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:29.939931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a538f-03e9-4bf6-8952-ee0edf5f3742 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:29.944979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:29.945707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.946043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.946290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.947226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:29.947443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:29.949118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:29.968946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 897/1763] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:29.969885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:29.994807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde2f03-466f-4d24-bd90-e865997da405 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.000157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.000967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.001479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.001562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.002364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.004462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.025959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b87d-c199-4b0a-80ba-aca36fb45300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.030556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45b87d-c199-4b0a-80ba-aca36fb45300 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.042388 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 867/1764] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:30.044030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e95ddf-f97d-4945-8156-a8021a28cac7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.044495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e95ddf-f97d-4945-8156-a8021a28cac7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.044916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e95ddf-f97d-4945-8156-a8021a28cac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.089439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-81e95ddf-f97d-4945-8156-a8021a28cac7 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:30.095109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-81e95ddf-f97d-4945-8156-a8021a28cac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:30.152859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 898/1765] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:29 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:30.153813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.322393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 868/1766] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:07:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:30.363317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784f6bb-a8de-47e8-a798-9dc6dc806ec8 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.383843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.384543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.384831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.385121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.385843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.387819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.526273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:30.533696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 899/1767] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:30 2022] POST /identity/v3/users => generated 293 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:30.535377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e95ddf-f97d-4945-8156-a8021a28cac7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.561446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e95ddf-f97d-4945-8156-a8021a28cac7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.580733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.584411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.584753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.585794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.586655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.590459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.624590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 869/1768] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:30.628369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.641707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22344a5-d444-411d-a540-68b5fca2b0d4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.667389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.668081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.668468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.668634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.669383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.671645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.713002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.723954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 900/1769] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:30.745496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1c38f-7ebe-4e75-be8c-6c45db2e1d52 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.763015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb783-85e6-4188-85e3-b7169084cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.765918 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb783-85e6-4188-85e3-b7169084cc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.775339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb783-85e6-4188-85e3-b7169084cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.780111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb783-85e6-4188-85e3-b7169084cc96 admin admin] PATH_INFO: `/v3/projects/808eca517bb045c8bf0c369e3157a4ec/users/a41ec1ddca0d43fca5b80cd59bbdc922/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.823240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb783-85e6-4188-85e3-b7169084cc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808eca517bb045c8bf0c369e3157a4ec, user_id=a41ec1ddca0d43fca5b80cd59bbdc922, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.826775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb783-85e6-4188-85e3-b7169084cc96 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.878590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:30.907830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.910015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:30.970232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 870/1770] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:30 2022] PUT /identity/v3/projects/808eca517bb045c8bf0c369e3157a4ec/users/a41ec1ddca0d43fca5b80cd59bbdc922/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:30.981075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897dd0a-ca3e-4bab-9ef6-72c963f0e795 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.985950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897dd0a-ca3e-4bab-9ef6-72c963f0e795 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.985950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897dd0a-ca3e-4bab-9ef6-72c963f0e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.039760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09b85-bb80-415d-9736-f4fe04a0498a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.061512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e897dd0a-ca3e-4bab-9ef6-72c963f0e795 None None] MFA Rules not processed for user `a41ec1ddca0d43fca5b80cd59bbdc922`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:31.063290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e897dd0a-ca3e-4bab-9ef6-72c963f0e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:31.143414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.144108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.144399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.144684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.258006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 871/1771] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:31.259681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897dd0a-ca3e-4bab-9ef6-72c963f0e795 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.275461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.277366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.309980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 901/1772] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:07:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:07:31.369592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897dd0a-ca3e-4bab-9ef6-72c963f0e795 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.378626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.381269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.391984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.392515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.393406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.405044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.544449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 872/1773] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:31 2022] POST /identity/v3/projects => generated 387 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:31.546505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.577846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12868e2-4b93-45d5-9957-26ca88c2d23b service swift] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.745935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.745935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:31.781188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.781724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.781988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.782315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.783485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.792046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.961575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 902/1774] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:31 2022] POST /identity/v3/users => generated 300 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:31.974809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.985167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab9a6-b15a-470d-92ff-514ae9a047d2 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.993484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65823a9-8937-4028-ba5d-6c10a589f8f0 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:32.002640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:32.003556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.003839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.006080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] PATH_INFO: `/v3/projects/cb0762c59f2d4cea8504bf7b2f911937` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:32.008943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0762c59f2d4cea8504bf7b2f911937)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:32.009541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:32.011343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.011659 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:32.012788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.013377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:32.015196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:32.017739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:32.080249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 903/1775] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:32.081862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:32.107984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83635a5d-96db-4cc1-b421-26bf5e781a09 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:32.123386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:32.129438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.130123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.131633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] PATH_INFO: `/v3/projects/4ba5ef354d064ff89aeb834d680f6578/users/9b29b296f516468bb6ab4d5cd68284b1/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:32.138299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:32.169780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba5ef354d064ff89aeb834d680f6578, user_id=9b29b296f516468bb6ab4d5cd68284b1, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:32.178954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:32.240570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0762c59f2d4cea8504bf7b2f911937', 'request_id': 'req-4636966c-aca4-4ee5-b07c-eef60b17d983'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:32.248913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0762c59f2d4cea8504bf7b2f911937', 'request_id': 'req-4636966c-aca4-4ee5-b07c-eef60b17d983'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:32.281958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0762c59f2d4cea8504bf7b2f911937', 'request_id': 'req-4636966c-aca4-4ee5-b07c-eef60b17d983'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:32.296219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 904/1776] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:32 2022] PUT /identity/v3/projects/4ba5ef354d064ff89aeb834d680f6578/users/9b29b296f516468bb6ab4d5cd68284b1/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:32.303628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:32.438601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] The token cache is being invalidate because project cb0762c59f2d4cea8504bf7b2f911937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:32.439278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:32.443322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:32.448447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 873/1777] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:31 2022] DELETE /identity/v3/projects/cb0762c59f2d4cea8504bf7b2f911937 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:32.461125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:32.462060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:32.630976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244638d-daad-4458-bac3-7aef92688743 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:32.637841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:32.638635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.639546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.639837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:32.640708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:32.646781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636966c-aca4-4ee5-b07c-eef60b17d983 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:32.648588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:32.657373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:32.658334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.658688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.659002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] PATH_INFO: `/v3/users/ca71a98f58c843bc84023f1d04c41200` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:32.664961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca71a98f58c843bc84023f1d04c41200)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:32.669736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:32.669930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 905/1778] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:32.681141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:32.695100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:32.735447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:32.747883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943201d-d9b4-49fb-ab3f-9d55f954966b admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:32.793151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72618001-6b79-4d04-877c-c2157dd6d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:32.799691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618001-6b79-4d04-877c-c2157dd6d76e admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.799691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618001-6b79-4d04-877c-c2157dd6d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.803291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618001-6b79-4d04-877c-c2157dd6d76e admin admin] PATH_INFO: `/v3/projects/4ba5ef354d064ff89aeb834d680f6578/users/9b29b296f516468bb6ab4d5cd68284b1/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:32.829194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72618001-6b79-4d04-877c-c2157dd6d76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba5ef354d064ff89aeb834d680f6578, user_id=9b29b296f516468bb6ab4d5cd68284b1, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:32.836151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72618001-6b79-4d04-877c-c2157dd6d76e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:32.878059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 906/1779] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:32 2022] PUT /identity/v3/projects/4ba5ef354d064ff89aeb834d680f6578/users/9b29b296f516468bb6ab4d5cd68284b1/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:32.891140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854069e-cced-41c3-a5a2-c61bba209346 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.891554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854069e-cced-41c3-a5a2-c61bba209346 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.891843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854069e-cced-41c3-a5a2-c61bba209346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:33.204503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e854069e-cced-41c3-a5a2-c61bba209346 None None] MFA Rules not processed for user `9b29b296f516468bb6ab4d5cd68284b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:33.204503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e854069e-cced-41c3-a5a2-c61bba209346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:33.207486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca71a98f58c843bc84023f1d04c41200'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:33.210232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 907/1780] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:33.344061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca71a98f58c843bc84023f1d04c41200'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:33.362193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca71a98f58c843bc84023f1d04c41200'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:33.365456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca71a98f58c843bc84023f1d04c41200'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:33.368050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca71a98f58c843bc84023f1d04c41200'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:33.437902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 874/1781] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:32 2022] DELETE /identity/v3/users/ca71a98f58c843bc84023f1d04c41200 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:33.453632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:33.453865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:33.454152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:33.515274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] MFA Rules not processed for user `c6bbb0e4d7ca44fc8cb68fdc96260caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:33.520018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:33.713863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 908/1782] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Jun 22 09:07:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:33.757310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:33.759224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:33.797496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7038d-1f0f-458d-a643-1ec7bea98714 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:33.811206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:33.811919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:33.812301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:33.812623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:33.826776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:33.828402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:33.849078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 875/1783] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:33.910267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:33.912268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:34.181730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:34.195579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975864a0-b7f0-4d38-a229-9bd0eb480d89 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:34.223731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c55419-4343-4232-b932-ee69d3560ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:34.224421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c55419-4343-4232-b932-ee69d3560ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:34.224714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c55419-4343-4232-b932-ee69d3560ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:34.225002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c55419-4343-4232-b932-ee69d3560ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:34.238699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-62c55419-4343-4232-b932-ee69d3560ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:34.473196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c55419-4343-4232-b932-ee69d3560ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:34.480233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c55419-4343-4232-b932-ee69d3560ea2 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:34.529847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 909/1784] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:34.726572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:34.733026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:34.986696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbe021-7035-43f0-a833-08d966a14834 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:34.993372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:34.994562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:34.994658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:34.994940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] PATH_INFO: `/v3/users/a41ec1ddca0d43fca5b80cd59bbdc922` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:34.996464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41ec1ddca0d43fca5b80cd59bbdc922)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:35.012768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:35.302967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41ec1ddca0d43fca5b80cd59bbdc922'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:35.570812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41ec1ddca0d43fca5b80cd59bbdc922'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:35.583424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41ec1ddca0d43fca5b80cd59bbdc922'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:35.587314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41ec1ddca0d43fca5b80cd59bbdc922'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:35.588577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41ec1ddca0d43fca5b80cd59bbdc922'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:35.665118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 876/1785] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:34 2022] DELETE /identity/v3/users/a41ec1ddca0d43fca5b80cd59bbdc922 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:35.667178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:35.671716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:35.672266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:35.729588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:35.732887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:35.799759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:35.875223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 910/1786] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:35.883912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:35.885482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:35.903574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:35.906906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:35.921611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43cb7f-487a-4f26-a286-c2d482fdea9e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:35.927947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:35.931040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:35.931040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:35.931040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] PATH_INFO: `/v3/projects/1c269d83371c4c07b0ec66506939b983` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:35.931040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c269d83371c4c07b0ec66506939b983)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:35.932886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.001389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bdacf-4079-43ea-91b8-bdfaad8315c1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.005168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f267-327e-4a8c-9858-382ee44c3bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:36.005856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f267-327e-4a8c-9858-382ee44c3bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.006144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f267-327e-4a8c-9858-382ee44c3bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.006423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f267-327e-4a8c-9858-382ee44c3bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.016628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f267-327e-4a8c-9858-382ee44c3bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:36.018317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f267-327e-4a8c-9858-382ee44c3bf8 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.028878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 877/1787] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:36.044378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:36.049430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c269d83371c4c07b0ec66506939b983', 'request_id': 'req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:36.056621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c269d83371c4c07b0ec66506939b983', 'request_id': 'req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:36.064396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c269d83371c4c07b0ec66506939b983', 'request_id': 'req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:36.163412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] The token cache is being invalidate because project 1c269d83371c4c07b0ec66506939b983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:36.168914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:36.168914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c097f44c-bc1f-4bb4-8cfa-fbee82f64561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:36.168914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 911/1788] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:35 2022] DELETE /identity/v3/projects/1c269d83371c4c07b0ec66506939b983 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:36.172164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10672-a22e-4edb-be8c-a4f446e6a01c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.172459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10672-a22e-4edb-be8c-a4f446e6a01c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.172914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10672-a22e-4edb-be8c-a4f446e6a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.192840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-cfe10672-a22e-4edb-be8c-a4f446e6a01c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:36.194320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-cfe10672-a22e-4edb-be8c-a4f446e6a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:36.287044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 878/1789] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:36.295629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07ef6-b98d-433c-8d25-b1369560c55c None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.296136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07ef6-b98d-433c-8d25-b1369560c55c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.296577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07ef6-b98d-433c-8d25-b1369560c55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.318892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-71d07ef6-b98d-433c-8d25-b1369560c55c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:36.320365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-71d07ef6-b98d-433c-8d25-b1369560c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:36.335244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 912/1790] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:36.339924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe10672-a22e-4edb-be8c-a4f446e6a01c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:36.350680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe10672-a22e-4edb-be8c-a4f446e6a01c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.357909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:36.359679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.360752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.360943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.361766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:36.362079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:36.363830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.381564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 879/1791] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:36.383074 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07ef6-b98d-433c-8d25-b1369560c55c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:36.394633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07ef6-b98d-433c-8d25-b1369560c55c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.401495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:36.402574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.404159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.405473 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.406426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:36.409586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.516541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 913/1792] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:36 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:36.520732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:36.537679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dae90-1103-4518-8f7e-00082ff8597d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.592705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:36.602894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:36.602894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.602894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.602894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.603589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:36.605554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.693954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 880/1793] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:36 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:36.695457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:36.707601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff47cca-c678-4148-a98a-889726649344 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.712656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:36.713394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.713750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.714099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.714966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:36.716669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.731852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 914/1794] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:36.736087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:36.757622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3323f-9bf0-4b29-b897-a9e6b5c97157 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.762188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:36.762901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.763190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.763520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.764255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:36.765871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.780479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 881/1795] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:36.781857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:36.795566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244adf-0f8b-4524-808a-3c63e69683ff admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.800683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174a20-a761-4f0a-bb06-4bedeb12f835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:36.801584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174a20-a761-4f0a-bb06-4bedeb12f835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.801867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174a20-a761-4f0a-bb06-4bedeb12f835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.802722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174a20-a761-4f0a-bb06-4bedeb12f835 admin admin] PATH_INFO: `/v3/projects/3883c28b6d2a4936a9a94da454b02e8a/users/010491cfc0084bd39f6b37a13a8099df/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:36.820695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174a20-a761-4f0a-bb06-4bedeb12f835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3883c28b6d2a4936a9a94da454b02e8a, user_id=010491cfc0084bd39f6b37a13a8099df, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:36.823254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22174a20-a761-4f0a-bb06-4bedeb12f835 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:36.896791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:36.899574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:36.930749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 915/1796] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:36 2022] PUT /identity/v3/projects/3883c28b6d2a4936a9a94da454b02e8a/users/010491cfc0084bd39f6b37a13a8099df/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:36.931337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562978e-be07-4660-9830-364b16f7b778 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:36.943515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ae602-2ccf-4f29-9dba-8e0392fdc3f2 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:36.946567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ae602-2ccf-4f29-9dba-8e0392fdc3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:36.947124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ae602-2ccf-4f29-9dba-8e0392fdc3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.028288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-bd4ae602-2ccf-4f29-9dba-8e0392fdc3f2 None None] MFA Rules not processed for user `010491cfc0084bd39f6b37a13a8099df`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:37.030093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bd4ae602-2ccf-4f29-9dba-8e0392fdc3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:37.090186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.093645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.093877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.094226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] PATH_INFO: `/v3/projects/808eca517bb045c8bf0c369e3157a4ec` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.096092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808eca517bb045c8bf0c369e3157a4ec)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.099074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:37.161706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 916/1797] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:37.164198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5c83-14ae-4289-a78e-0e8ef7570e04 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.164688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5c83-14ae-4289-a78e-0e8ef7570e04 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.165152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde5c83-14ae-4289-a78e-0e8ef7570e04 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.166934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 917/1798] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:37.170678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde5c83-14ae-4289-a78e-0e8ef7570e04 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:37.194945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde5c83-14ae-4289-a78e-0e8ef7570e04 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:37.208987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808eca517bb045c8bf0c369e3157a4ec', 'request_id': 'req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.221640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808eca517bb045c8bf0c369e3157a4ec', 'request_id': 'req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.263593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808eca517bb045c8bf0c369e3157a4ec', 'request_id': 'req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.300868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.301625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.302103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.302567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.309098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.309098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:37.324294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:37.332020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] The token cache is being invalidate because project 808eca517bb045c8bf0c369e3157a4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:37.335371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.335371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9143e88f-8ad2-438f-aa3c-ea6d3de6abe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.335969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 882/1799] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:36 2022] DELETE /identity/v3/projects/808eca517bb045c8bf0c369e3157a4ec => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:37.336881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.337165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.337515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.380972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:37.382471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:37.434017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 918/1800] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:37 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:37.435135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:37.437820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:37.482300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 883/1801] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:07:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:37.483549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:37.486243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:37.502561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5002-2e45-4233-9ffb-ec54ddca06bd None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:37.530024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd88b61-c078-467a-9c76-0a16b0a21c5f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:37.535840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.536740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.537027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.537301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] PATH_INFO: `/v3/users/9b29b296f516468bb6ab4d5cd68284b1` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.538533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b29b296f516468bb6ab4d5cd68284b1)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.541299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:37.595144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.596814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.597270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.597790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.598946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.601265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:37.689981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 884/1802] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:37 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:37.690816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:37.692376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:37.763050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4ce87-e6a2-4598-b464-387766c3c38a admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:37.769390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.770044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.770333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.770615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.771795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b29b296f516468bb6ab4d5cd68284b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.779526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.779679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b29b296f516468bb6ab4d5cd68284b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.780243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b29b296f516468bb6ab4d5cd68284b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.780852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b29b296f516468bb6ab4d5cd68284b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.781116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:37.791797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 885/1803] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:37.792432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:37.802324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789002c-7554-4cf9-9e3b-0491136076d3 service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:37.804769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cec2d815-bf61-49d3-8a0e-5044a62cda2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b29b296f516468bb6ab4d5cd68284b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:37.807042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.807679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.813108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.813108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.813108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.813108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:37.824268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 886/1804] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:37.825341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:37.827630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:37.838479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:37.842141 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93c2ae-93a8-4f59-b62b-674f3016cb2d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:37.847044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.848058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.848358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.848640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.849369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.850998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:37.861601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 887/1805] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:07:37.865804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:37.876447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831956d0-6629-47b7-8ef8-71428d40504e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:37.881476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:37.882479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:37.882767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:37.883079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] PATH_INFO: `/v3/projects/9f5ce551141842d089e8b5faa7ffaa7b/users/920598ff465843a8b1e5529ecbf989fb/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:37.901178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5ce551141842d089e8b5faa7ffaa7b, user_id=920598ff465843a8b1e5529ecbf989fb, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:37.904902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 919/1806] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:37 2022] DELETE /identity/v3/users/9b29b296f516468bb6ab4d5cd68284b1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:37.905199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:38.016643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 888/1807] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:37 2022] PUT /identity/v3/projects/9f5ce551141842d089e8b5faa7ffaa7b/users/920598ff465843a8b1e5529ecbf989fb/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:38.027424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600bc71-fd5c-4e42-a48c-a38989834f61 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:38.028048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600bc71-fd5c-4e42-a48c-a38989834f61 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:38.028617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600bc71-fd5c-4e42-a48c-a38989834f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:38.076439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9600bc71-fd5c-4e42-a48c-a38989834f61 None None] MFA Rules not processed for user `920598ff465843a8b1e5529ecbf989fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:38.078114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9600bc71-fd5c-4e42-a48c-a38989834f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:38.164497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 920/1808] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:38.171289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:38.288110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c6225-0e0a-4940-97e4-ee60093a154c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:38.293298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:38.294341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:38.295166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:38.295786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:38.296752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:38.298909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:38.560491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 889/1809] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:38 2022] POST /identity/v3/projects => generated 375 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:38.564178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600bc71-fd5c-4e42-a48c-a38989834f61 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:38.604690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600bc71-fd5c-4e42-a48c-a38989834f61 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:38.736691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:38.738792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:38.741045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:38.741470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:38.743970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:38.747008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:38.783677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:38.785742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:38.832853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a51487-3350-4e93-ad56-04e47e53709c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:38.840675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:38.842631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:38.843795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:38.844355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:38.844640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] PATH_INFO: `/v3/projects/4ba5ef354d064ff89aeb834d680f6578` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:38.854347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 921/1810] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:38 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:38.857942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:38.861633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba5ef354d064ff89aeb834d680f6578)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:38.868965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:38.886431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b1ae2-d493-43a8-81b8-6d3734bc4bc6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:38.901895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:38.904599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:38.904599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:38.904599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:38.904599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:38.907214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:38.934719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 922/1811] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:07:38.936416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:38.956992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fba8ba-9312-483d-878c-d29acc0beced admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:38.962066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:38.963079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:38.963264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:38.963577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] PATH_INFO: `/v3/projects/6fd21e908c79483a9d1815f34c3c1c70/users/2bf6857780bc45328aaacfa4c873fddf/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:38.982202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd21e908c79483a9d1815f34c3c1c70, user_id=2bf6857780bc45328aaacfa4c873fddf, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:38.984966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:39.315001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:39.331506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba5ef354d064ff89aeb834d680f6578', 'request_id': 'req-70e3cb7e-3f39-47e4-9714-4a482d17c93b'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:39.335855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 923/1812] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:38 2022] PUT /identity/v3/projects/6fd21e908c79483a9d1815f34c3c1c70/users/2bf6857780bc45328aaacfa4c873fddf/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:39.340607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:39.347702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba5ef354d064ff89aeb834d680f6578', 'request_id': 'req-70e3cb7e-3f39-47e4-9714-4a482d17c93b'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:39.360976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba5ef354d064ff89aeb834d680f6578', 'request_id': 'req-70e3cb7e-3f39-47e4-9714-4a482d17c93b'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:39.414602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fdfe6-7b78-4f1f-ae8b-2bfef56dfed0 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:39.428238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] The token cache is being invalidate because project 4ba5ef354d064ff89aeb834d680f6578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:39.428794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:39.429519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70e3cb7e-3f39-47e4-9714-4a482d17c93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:39.431829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 890/1813] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:38 2022] DELETE /identity/v3/projects/4ba5ef354d064ff89aeb834d680f6578 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:39.436783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270012b-e822-4658-90da-05954c94fade None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.437078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270012b-e822-4658-90da-05954c94fade None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.437360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270012b-e822-4658-90da-05954c94fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.460807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a270012b-e822-4658-90da-05954c94fade None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:39.462492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a270012b-e822-4658-90da-05954c94fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:39.515590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:39.525378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.525698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.526038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.526807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:39.528630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:39.551031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 924/1814] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:07:39.553054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 891/1815] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:39.556207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:39.558067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:39.563933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987228e-4769-4e8e-953e-0b304600c90c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.564965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987228e-4769-4e8e-953e-0b304600c90c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.565277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987228e-4769-4e8e-953e-0b304600c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.572445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829730f-7c09-4424-9e7c-bdd2b44bff2a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:39.579450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528043c-c005-48d1-b3d0-59f123a48fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:39.580363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528043c-c005-48d1-b3d0-59f123a48fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.580654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528043c-c005-48d1-b3d0-59f123a48fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.580936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528043c-c005-48d1-b3d0-59f123a48fdc admin admin] PATH_INFO: `/v3/projects/6fd21e908c79483a9d1815f34c3c1c70/users/2bf6857780bc45328aaacfa4c873fddf/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.588852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528043c-c005-48d1-b3d0-59f123a48fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd21e908c79483a9d1815f34c3c1c70, user_id=2bf6857780bc45328aaacfa4c873fddf, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:39.593578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528043c-c005-48d1-b3d0-59f123a48fdc admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:39.597103 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-8987228e-4769-4e8e-953e-0b304600c90c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:39.600246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8987228e-4769-4e8e-953e-0b304600c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:39.606607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 925/1816] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:39 2022] PUT /identity/v3/projects/6fd21e908c79483a9d1815f34c3c1c70/users/2bf6857780bc45328aaacfa4c873fddf/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:39.620371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cf650-35b3-403d-aa8c-589732819e39 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.623147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cf650-35b3-403d-aa8c-589732819e39 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.623869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cf650-35b3-403d-aa8c-589732819e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.713641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-957cf650-35b3-403d-aa8c-589732819e39 None None] MFA Rules not processed for user `2bf6857780bc45328aaacfa4c873fddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:39.713641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-957cf650-35b3-403d-aa8c-589732819e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:39.714646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 892/1817] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:39.725872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987228e-4769-4e8e-953e-0b304600c90c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:39.743331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987228e-4769-4e8e-953e-0b304600c90c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:39.762815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:39.764795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.765309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.765986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.767673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:39.768668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:39.771186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:39.800225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 926/1818] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:39.811398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cf650-35b3-403d-aa8c-589732819e39 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:39.821578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 893/1819] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:39.822514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:39.824350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:39.847843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cf650-35b3-403d-aa8c-589732819e39 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:39.874207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:39.875752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.876241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.877676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.878886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:39.882377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:39.963481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a880ab-2d19-448a-8cdf-9db9c6df49d7 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:39.967932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:39.968884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:39.969382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:39.969876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:39.990438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:39.990438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:39.999000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 894/1820] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:40.056123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 927/1821] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:39 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:07:40.060550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:40.072017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5e964-5d6e-4a41-8b8d-a429fc956d36 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:40.149785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:40.211930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:40.212633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:40.214882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:40.215236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:40.218049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:40.223722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:40.242931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fef02-d5cd-4c3d-b6e4-53cc3623f267 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:40.246928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:40.250434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:40.250434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:40.250434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:40.250678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:40.291719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:40.305875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 895/1822] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:40 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:40.307918 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:40.311799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:40.329622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966795-adda-4f61-a98a-70bb59c52309 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:40.336335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:40.337221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:40.337505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:40.337807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] PATH_INFO: `/v3/users/3a737cb85e72476b8a10dd52382e25af` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:40.339052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a737cb85e72476b8a10dd52382e25af)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:40.341175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:40.349413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:40.351799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:40.375869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 928/1823] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:40.376815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:40.410178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c8f74-b323-44ab-8728-003d2fa68bab service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:40.410178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:40.410178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:40.410178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:40.410628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:40.411077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:40.418379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:40.438699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 929/1824] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:40.451557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:40.473303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84031807-a54f-4ae0-88df-63469eac3158 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:40.507577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:40.507577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:40.507577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:40.507577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:40.508205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:40.508205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:40.508205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 930/1825] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:40.513364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:40.527902 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e56ab8-4f48-47ea-8462-729ccfb561f5 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:40.533466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1a92-8f5b-4143-9cab-8affd19c097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:40.534556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1a92-8f5b-4143-9cab-8affd19c097a admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:40.535262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1a92-8f5b-4143-9cab-8affd19c097a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:40.535370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1a92-8f5b-4143-9cab-8affd19c097a admin admin] PATH_INFO: `/v3/projects/be9c8026f1ed4a90b056fa30e968d292/users/b300a01bc63f4f8c8a82f877071480e9/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:40.579066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1a92-8f5b-4143-9cab-8affd19c097a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9c8026f1ed4a90b056fa30e968d292, user_id=b300a01bc63f4f8c8a82f877071480e9, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:40.584320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1a92-8f5b-4143-9cab-8affd19c097a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:40.736088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 931/1826] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:40 2022] PUT /identity/v3/projects/be9c8026f1ed4a90b056fa30e968d292/users/b300a01bc63f4f8c8a82f877071480e9/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:40.747715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734bcb-b51b-4959-96a3-0a8a0d918582 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:40.763378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734bcb-b51b-4959-96a3-0a8a0d918582 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:40.763378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734bcb-b51b-4959-96a3-0a8a0d918582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:40.776545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0f734bcb-b51b-4959-96a3-0a8a0d918582 None None] MFA Rules not processed for user `b300a01bc63f4f8c8a82f877071480e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:40.777920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0f734bcb-b51b-4959-96a3-0a8a0d918582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:40.878507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 932/1827] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:40.883575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734bcb-b51b-4959-96a3-0a8a0d918582 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:40.932606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a737cb85e72476b8a10dd52382e25af'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:41.002565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734bcb-b51b-4959-96a3-0a8a0d918582 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:41.010092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:41.010781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:41.011098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:41.011383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:41.012123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:41.014422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:41.027986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a737cb85e72476b8a10dd52382e25af'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:41.039423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a737cb85e72476b8a10dd52382e25af'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:41.040422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a737cb85e72476b8a10dd52382e25af'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:41.041280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-daec466c-f965-4e04-b98d-8e1a49c51366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a737cb85e72476b8a10dd52382e25af'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:41.077221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 896/1828] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:40 2022] DELETE /identity/v3/users/3a737cb85e72476b8a10dd52382e25af => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:41.082162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2968a-3f53-476f-805e-a195710f631c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:41.083337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2968a-3f53-476f-805e-a195710f631c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:41.084048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2968a-3f53-476f-805e-a195710f631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:41.111896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-36b2968a-3f53-476f-805e-a195710f631c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:41.114360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-36b2968a-3f53-476f-805e-a195710f631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:41.144121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 933/1829] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:40 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:41.146645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:41.151458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:41.274119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 897/1830] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:41.274119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2968a-3f53-476f-805e-a195710f631c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:41.274119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-36b2968a-3f53-476f-805e-a195710f631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:41.289313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491e94-15e2-462c-8570-c9c08409de9f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:41.307551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:41.308418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:41.311865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:41.312188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:41.313368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:41.321471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:41.396026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2968a-3f53-476f-805e-a195710f631c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:41.468357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 934/1831] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:41 2022] POST /identity/v3/users => generated 295 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:41.469778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:41.485172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1fb9-bac1-4d63-bbfd-c79bd9c8bbb4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:41.490394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:41.491304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:41.491662 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:41.492248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:41.501864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:41.502673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:41.503000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:41.503430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:41.504166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:41.506865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:41.527087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:41.531268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:41.531508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 935/1832] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:41.535124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:41.553061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86d03-9201-46db-a1f2-0f4f7a1e65e7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:41.556076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 898/1833] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:41.561709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:41.564838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:41.564838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:41.564838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] PATH_INFO: `/v3/projects/7720d96486a8413fa0f8695032d8bd8c/users/b63198211a154a78ba43a7384b037942/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:41.588960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7720d96486a8413fa0f8695032d8bd8c, user_id=b63198211a154a78ba43a7384b037942, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:41.593980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:41.668613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 936/1834] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:41 2022] PUT /identity/v3/projects/7720d96486a8413fa0f8695032d8bd8c/users/b63198211a154a78ba43a7384b037942/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:41.676070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:41.716937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc456d1-cb38-49e4-987a-72ecd703d94a service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:41.977018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943960-126b-4b96-8e92-5d2f5f72e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:41.977018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943960-126b-4b96-8e92-5d2f5f72e4db admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:41.977018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943960-126b-4b96-8e92-5d2f5f72e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:41.977018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943960-126b-4b96-8e92-5d2f5f72e4db admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:41.978104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943960-126b-4b96-8e92-5d2f5f72e4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:41.978104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943960-126b-4b96-8e92-5d2f5f72e4db admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:41.987182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 899/1835] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:41.993702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:42.027265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c64d4c-b2d3-4087-86f0-5ef47fa342f7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:42.051233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:42.058367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:42.058678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:42.059978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] PATH_INFO: `/v3/projects/7720d96486a8413fa0f8695032d8bd8c/users/b63198211a154a78ba43a7384b037942/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:42.067942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7720d96486a8413fa0f8695032d8bd8c, user_id=b63198211a154a78ba43a7384b037942, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:42.081887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:42.114173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 937/1836] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:41 2022] PUT /identity/v3/projects/7720d96486a8413fa0f8695032d8bd8c/users/b63198211a154a78ba43a7384b037942/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:42.125220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:42.125862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:42.126261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:42.167109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] MFA Rules not processed for user `b63198211a154a78ba43a7384b037942`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:42.167109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:42.188076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:42.330073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 900/1837] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:42.344719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:42.346499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:42.505559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace4be7-d6e1-4667-9e13-d454aef07c4f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:42.520273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0529c-b2de-4535-ba8c-639189800e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:42.520955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0529c-b2de-4535-ba8c-639189800e73 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:42.521238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0529c-b2de-4535-ba8c-639189800e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:42.521616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0529c-b2de-4535-ba8c-639189800e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:42.533247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0529c-b2de-4535-ba8c-639189800e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:42.559075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0529c-b2de-4535-ba8c-639189800e73 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:42.574668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 938/1838] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:43.016067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:43.019111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:43.225109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7fc1-c85b-4211-9e96-c09fa5c8cc2f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:43.266048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:43.267038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:43.267488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:43.267862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] PATH_INFO: `/v3/projects/a344884cd14648f6ab96d4662d3dc893` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:43.269549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a344884cd14648f6ab96d4662d3dc893)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:43.272678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:43.415294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:43.451824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a344884cd14648f6ab96d4662d3dc893', 'request_id': 'req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:43.469556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a344884cd14648f6ab96d4662d3dc893', 'request_id': 'req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:43.477964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5e73-3958-474b-bea6-80c1d6760523 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:43.478598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5e73-3958-474b-bea6-80c1d6760523 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:43.479245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5e73-3958-474b-bea6-80c1d6760523 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:43.481129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 939/1839] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:07:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:07:43.493854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a344884cd14648f6ab96d4662d3dc893', 'request_id': 'req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:43.793235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] The token cache is being invalidate because project a344884cd14648f6ab96d4662d3dc893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:43.793235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:43.793235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:43.793235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 901/1840] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:43 2022] DELETE /identity/v3/projects/a344884cd14648f6ab96d4662d3dc893 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:43.797748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:43.797748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:43.797748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:43.797748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:43.797748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:43.798569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:43.809521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:43.847445 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 940/1841] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:07:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:43.879599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:43.882787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:43.928496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e042-ca33-4bac-be87-93aac2552354 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:43.946625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:43.948156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:43.948462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:43.949654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:43.984528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:43.986202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:44.012651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 941/1842] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:44.021192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb4f8-6308-4b7c-81ab-61d7f5c4f4cf admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:44.046779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:44.048113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:44.048443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:44.048726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] PATH_INFO: `/v3/users/66a4202908e948ceb7269c3052587658` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:44.055166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a4202908e948ceb7269c3052587658)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:44.060611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:44.496739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a4202908e948ceb7269c3052587658'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:44.660817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a4202908e948ceb7269c3052587658'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:44.684622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a4202908e948ceb7269c3052587658'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:44.686895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a4202908e948ceb7269c3052587658'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:44.689137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a4202908e948ceb7269c3052587658'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:44.717015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:44.719594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:44.743002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 902/1843] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:43 2022] DELETE /identity/v3/users/66a4202908e948ceb7269c3052587658 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:44.918605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce54fc9-3339-42e3-a661-6f7b9dba4555 service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:45.046732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63198211a154a78ba43a7384b037942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7720d96486a8413fa0f8695032d8bd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:45.047254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:45.047547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:45.047831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:45.048671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:45.049041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:45.050895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:45.099203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 942/1844] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:45.108771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:45.112303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:45.156544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cfbb7-3a9d-495f-babe-f5fbb6f08822 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:45.180203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63198211a154a78ba43a7384b037942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7720d96486a8413fa0f8695032d8bd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:45.180203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:45.180203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:45.180541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:45.180541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:45.185542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:45.420313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 903/1845] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:45 2022] POST /identity/v3/projects => generated 354 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:45.427265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:45.455079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d92fe9-91ce-4b7c-8b5a-3c65c7c105e7 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:45.552135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:45.554145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:45.619777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63198211a154a78ba43a7384b037942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7720d96486a8413fa0f8695032d8bd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:45.620467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:45.620762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:45.621060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:45.621826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:45.622146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:45.623795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:45.691020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 943/1846] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:45.715291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44428293-9f06-4e4c-bc30-ed59cf7d5af0 tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:45.723735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:45.725178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:45.725744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:45.726244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] PATH_INFO: `/v3/users/ac6eab264acd498ea06cfa8315a41ec1` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:45.728503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6eab264acd498ea06cfa8315a41ec1)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:45.732054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:45.755809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:45.772315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee13e-7990-45c6-8e73-f1c6c32d5fcf tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:45.779533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b63198211a154a78ba43a7384b037942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7720d96486a8413fa0f8695032d8bd8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:45.780889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:45.781329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:45.781757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] PATH_INFO: `/v3/projects/9e62e37bdc1a413c8813fd83e18eb740` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:45.787384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e62e37bdc1a413c8813fd83e18eb740)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:45.803203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:45.976589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6eab264acd498ea06cfa8315a41ec1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.009348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e62e37bdc1a413c8813fd83e18eb740', 'request_id': 'req-02ad1563-7c5c-4752-9753-591b0489cf5b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.023061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e62e37bdc1a413c8813fd83e18eb740', 'request_id': 'req-02ad1563-7c5c-4752-9753-591b0489cf5b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.032147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e62e37bdc1a413c8813fd83e18eb740', 'request_id': 'req-02ad1563-7c5c-4752-9753-591b0489cf5b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.072604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6eab264acd498ea06cfa8315a41ec1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.082612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6eab264acd498ea06cfa8315a41ec1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.083526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6eab264acd498ea06cfa8315a41ec1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.084239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-900bc202-2945-431b-8ef9-24f45eecffd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6eab264acd498ea06cfa8315a41ec1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.105143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 904/1847] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:45 2022] DELETE /identity/v3/users/ac6eab264acd498ea06cfa8315a41ec1 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:46.109611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.110127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.110334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.129582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:46.134185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:46.140929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] The token cache is being invalidate because project 9e62e37bdc1a413c8813fd83e18eb740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:46.141577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.143603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.146335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:46.153283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 944/1848] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:45 2022] DELETE /identity/v3/projects/9e62e37bdc1a413c8813fd83e18eb740 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:46.231504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 905/1849] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:46.237578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:46.239659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:46.265957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:46.267450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:46.286733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cb9fb-7f10-46bb-be72-15c35b038567 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:46.292431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:46.293777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.295000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.295430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] PATH_INFO: `/v3/projects/3a855ee6801c44609d46b94721071f0d` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.296964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a855ee6801c44609d46b94721071f0d)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:46.299046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:46.319730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:46.370928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad1563-7c5c-4752-9753-591b0489cf5b tempest-VolumeQuotaClassesTest-12372055 tempest-VolumeQuotaClassesTest-12372055-project-admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:46.437251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc78ece-ebc4-4e68-8239-e18dab41c8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:46.438318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc78ece-ebc4-4e68-8239-e18dab41c8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.438959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc78ece-ebc4-4e68-8239-e18dab41c8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.439253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc78ece-ebc4-4e68-8239-e18dab41c8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.441512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a855ee6801c44609d46b94721071f0d', 'request_id': 'req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.448204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a855ee6801c44609d46b94721071f0d', 'request_id': 'req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.449814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc78ece-ebc4-4e68-8239-e18dab41c8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:46.452056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc78ece-ebc4-4e68-8239-e18dab41c8e6 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:46.455217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a855ee6801c44609d46b94721071f0d', 'request_id': 'req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.464471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 945/1850] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:46.536279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] The token cache is being invalidate because project 3a855ee6801c44609d46b94721071f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:46.536488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.539618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-81f5f04e-bd96-4ca7-bc80-e0c0720b09df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:46.547768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307323fa-fafd-4a1c-957a-33c7e75c0f9a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.548194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307323fa-fafd-4a1c-957a-33c7e75c0f9a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.548554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307323fa-fafd-4a1c-957a-33c7e75c0f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.550396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 906/1851] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:46 2022] DELETE /identity/v3/projects/3a855ee6801c44609d46b94721071f0d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:46.579180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-307323fa-fafd-4a1c-957a-33c7e75c0f9a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:46.580692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-307323fa-fafd-4a1c-957a-33c7e75c0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:46.655431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 946/1852] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:46.661298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38ff5-d6cc-41d5-bae7-bd3a5f88445c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.661985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38ff5-d6cc-41d5-bae7-bd3a5f88445c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.662372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb38ff5-d6cc-41d5-bae7-bd3a5f88445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.689304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-8fb38ff5-d6cc-41d5-bae7-bd3a5f88445c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:46.690886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8fb38ff5-d6cc-41d5-bae7-bd3a5f88445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:46.706055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307323fa-fafd-4a1c-957a-33c7e75c0f9a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:46.712002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 907/1853] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:46.718658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307323fa-fafd-4a1c-957a-33c7e75c0f9a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:46.723756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:46.724439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.724756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.725011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.725759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:46.726070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:46.728186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:46.747810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38ff5-d6cc-41d5-bae7-bd3a5f88445c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:46.752342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 947/1854] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:46.757892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb38ff5-d6cc-41d5-bae7-bd3a5f88445c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:46.763485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:46.764162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.764439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.764887 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.765746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:46.769350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:46.848565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 908/1855] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:46 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:46.849441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:46.860666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a48e-c82a-42d0-b470-ab2a3b80fc34 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:46.892521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:46.894873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:46.939249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:46.940039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.940326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.940607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.942125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:46.944159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:46.980807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb593-bb74-4aba-81f1-c890512d295c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:46.985652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:46.986522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:46.989368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:46.989368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] PATH_INFO: `/v3/users/b300a01bc63f4f8c8a82f877071480e9` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:46.989368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b300a01bc63f4f8c8a82f877071480e9)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:46.990191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.058573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 948/1856] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:46 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:07:47.061896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.077276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebacad-7bf4-417b-9629-bee47b580e8f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.087041 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.087442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.087739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.088004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.088874 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.091067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.101266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 949/1857] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:07:47.105811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.117661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b130d74-ff3c-45cf-b289-205562345d65 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.121744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.123038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.123321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.123598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.124338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.125979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.136575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 950/1858] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:47.141387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.163368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa16b80-5a8b-4461-a56e-69834ea30cc3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.168821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.170479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.170596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.170975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] PATH_INFO: `/v3/projects/6fa2a998362c44238ce3527a52e8269a/users/78b7a8d913d9417d820a9c429b1f1f4d/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.195037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa2a998362c44238ce3527a52e8269a, user_id=78b7a8d913d9417d820a9c429b1f1f4d, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.197973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.232944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b300a01bc63f4f8c8a82f877071480e9'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.272260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 951/1859] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:47 2022] PUT /identity/v3/projects/6fa2a998362c44238ce3527a52e8269a/users/78b7a8d913d9417d820a9c429b1f1f4d/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:47.273180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.274792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.308381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b300a01bc63f4f8c8a82f877071480e9'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.320459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b300a01bc63f4f8c8a82f877071480e9'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.322642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b300a01bc63f4f8c8a82f877071480e9'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.323329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b300a01bc63f4f8c8a82f877071480e9'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.345789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 909/1860] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:46 2022] DELETE /identity/v3/users/b300a01bc63f4f8c8a82f877071480e9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:47.346874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.347902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.378731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b9c2-becc-4f85-b60e-45a353b81b28 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.433609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409897-662e-450f-beff-4cbc6d3ab2a7 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.439967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.440383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.440998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.441342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.441635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.441745 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] PATH_INFO: `/v3/projects/542849edf35348f3a0c3617faf77d809` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.441873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.442160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] PATH_INFO: `/v3/users/010491cfc0084bd39f6b37a13a8099df` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.443420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=010491cfc0084bd39f6b37a13a8099df)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.443549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542849edf35348f3a0c3617faf77d809)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.445358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.448317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.565599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542849edf35348f3a0c3617faf77d809', 'request_id': 'req-f9dcdf07-7571-45fc-a96e-64444778bd29'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.574481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542849edf35348f3a0c3617faf77d809', 'request_id': 'req-f9dcdf07-7571-45fc-a96e-64444778bd29'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.581779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542849edf35348f3a0c3617faf77d809', 'request_id': 'req-f9dcdf07-7571-45fc-a96e-64444778bd29'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.680082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] The token cache is being invalidate because project 542849edf35348f3a0c3617faf77d809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:47.680690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.681417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f9dcdf07-7571-45fc-a96e-64444778bd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.683230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 952/1861] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:47 2022] DELETE /identity/v3/projects/542849edf35348f3a0c3617faf77d809 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:47.684505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517212-5e66-48c1-bb22-90683286acdf None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.689069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517212-5e66-48c1-bb22-90683286acdf None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.689069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517212-5e66-48c1-bb22-90683286acdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.690581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010491cfc0084bd39f6b37a13a8099df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.704896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9b517212-5e66-48c1-bb22-90683286acdf None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:47.706110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9b517212-5e66-48c1-bb22-90683286acdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.774368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 953/1862] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:47.775130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010491cfc0084bd39f6b37a13a8099df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.775722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.776019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.776297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.785483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010491cfc0084bd39f6b37a13a8099df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.786523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010491cfc0084bd39f6b37a13a8099df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.787396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010491cfc0084bd39f6b37a13a8099df'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:47.794768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:47.795999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.805195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 954/1863] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:47.806092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.807494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.815018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 910/1864] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:47 2022] DELETE /identity/v3/users/010491cfc0084bd39f6b37a13a8099df => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:47.816109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.818246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.821505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da224d1-5c82-4575-8bcd-b341d32d48c8 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.891276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.891974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad55c-127e-4364-bb26-bcff88c65fcd admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.894245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.894842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.895440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] PATH_INFO: `/v3/users/f3ae32635e0a43c691789b8f894b454f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.896123 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.896883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.897206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ae32635e0a43c691789b8f894b454f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.897408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.897759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.899639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.899773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.912956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.914487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.926199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 911/1865] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:47.927173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:47.936333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea5ce-40cb-4dd9-8122-d6f7ee1c7309 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:47.940560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249c77-4243-4210-be91-a7f5dd3a481b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:47.941421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249c77-4243-4210-be91-a7f5dd3a481b service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.941786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249c77-4243-4210-be91-a7f5dd3a481b service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.942137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249c77-4243-4210-be91-a7f5dd3a481b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.952876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249c77-4243-4210-be91-a7f5dd3a481b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:47.954550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249c77-4243-4210-be91-a7f5dd3a481b service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:47.964993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 912/1866] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:47.966607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:47.967023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:47.967472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:47.987366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:47.988614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:47.996880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 913/1867] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:48.023987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:48.025667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:48.038357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3cc43-bc67-47f3-b3f4-ad577183718d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:48.042191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:48.042881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:48.043173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:48.043457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:48.054195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:48.055177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:48.066669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 914/1868] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:48.129360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ae32635e0a43c691789b8f894b454f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:48.138876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ae32635e0a43c691789b8f894b454f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:48.141513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ae32635e0a43c691789b8f894b454f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:48.141513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ae32635e0a43c691789b8f894b454f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:48.155132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ae32635e0a43c691789b8f894b454f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:48.223872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 955/1869] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:47 2022] DELETE /identity/v3/users/f3ae32635e0a43c691789b8f894b454f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:48.772453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:48.785000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:48.815900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09def8a1-e09d-4f85-a932-2fa42dd4f085 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:48.849651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:48.905021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:48.907422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:48.962415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:48.963496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:48.963794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:48.964079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] PATH_INFO: `/v3/projects/be9c8026f1ed4a90b056fa30e968d292` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:48.965355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9c8026f1ed4a90b056fa30e968d292)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:48.967340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:49.026934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:49.027115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c423e-abb2-495d-98e6-176f361349ce admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:49.033260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:49.034174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:49.034438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:49.034719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] PATH_INFO: `/v3/projects/3883c28b6d2a4936a9a94da454b02e8a` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:49.036348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3883c28b6d2a4936a9a94da454b02e8a)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:49.038534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:49.127574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9c8026f1ed4a90b056fa30e968d292', 'request_id': 'req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.135274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9c8026f1ed4a90b056fa30e968d292', 'request_id': 'req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.142717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9c8026f1ed4a90b056fa30e968d292', 'request_id': 'req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.172614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3883c28b6d2a4936a9a94da454b02e8a', 'request_id': 'req-240ca424-e119-4bc7-a718-2537aa4b6647'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.179660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3883c28b6d2a4936a9a94da454b02e8a', 'request_id': 'req-240ca424-e119-4bc7-a718-2537aa4b6647'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.186892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3883c28b6d2a4936a9a94da454b02e8a', 'request_id': 'req-240ca424-e119-4bc7-a718-2537aa4b6647'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.226366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] The token cache is being invalidate because project be9c8026f1ed4a90b056fa30e968d292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:49.227083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.228488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.234728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 915/1870] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:48 2022] DELETE /identity/v3/projects/be9c8026f1ed4a90b056fa30e968d292 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:49.234728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:49.236570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:49.283975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] The token cache is being invalidate because project 3883c28b6d2a4936a9a94da454b02e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:49.284773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.285919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.287663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 956/1871] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:48 2022] DELETE /identity/v3/projects/3883c28b6d2a4936a9a94da454b02e8a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:49.290927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:49.290927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:49.340120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9894-ead7-416b-9f99-4bcd5bd7e120 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:49.379098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca424-e119-4bc7-a718-2537aa4b6647 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:49.384873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:49.386018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:49.386480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:49.387048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] PATH_INFO: `/v3/users/b63198211a154a78ba43a7384b037942` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:49.391904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63198211a154a78ba43a7384b037942)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:49.391904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:49.410065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:49.411013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:49.411394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:49.411570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] PATH_INFO: `/v3/projects/428543e27d04489e92aa2b17ebbde3c9` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:49.412792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=428543e27d04489e92aa2b17ebbde3c9)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:49.414754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:49.593351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428543e27d04489e92aa2b17ebbde3c9', 'request_id': 'req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.594154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63198211a154a78ba43a7384b037942'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.599543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428543e27d04489e92aa2b17ebbde3c9', 'request_id': 'req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.601059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63198211a154a78ba43a7384b037942'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.601732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63198211a154a78ba43a7384b037942'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.602610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63198211a154a78ba43a7384b037942'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.605688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428543e27d04489e92aa2b17ebbde3c9', 'request_id': 'req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.616281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b1ce61c4-c8ae-44d7-a68a-f46b8aa409e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63198211a154a78ba43a7384b037942'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.672583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:49.705789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] The token cache is being invalidate because project 428543e27d04489e92aa2b17ebbde3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:49.706084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.706737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:49.708345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 916/1872] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:49 2022] DELETE /identity/v3/projects/428543e27d04489e92aa2b17ebbde3c9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:49.709116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:49.710369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:49.774160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c9da8-557f-4c8b-b11e-ef0c98d452ee admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:49.785151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:49.785831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:49.786187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:49.786740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] PATH_INFO: `/v3/users/920598ff465843a8b1e5529ecbf989fb` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:49.788084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=920598ff465843a8b1e5529ecbf989fb)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:49.790707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:49.844385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 957/1873] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:49 2022] DELETE /identity/v3/users/b63198211a154a78ba43a7384b037942 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:49.848585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7fd59-5199-4607-8b02-4130955a31d3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:49.849008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7fd59-5199-4607-8b02-4130955a31d3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:49.849388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7fd59-5199-4607-8b02-4130955a31d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:49.872701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-38c7fd59-5199-4607-8b02-4130955a31d3 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:49.874213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-38c7fd59-5199-4607-8b02-4130955a31d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:49.953057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 958/1874] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:49.955782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fc44b-f033-43ee-b354-2c3c07156301 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:49.956343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fc44b-f033-43ee-b354-2c3c07156301 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:49.957116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fc44b-f033-43ee-b354-2c3c07156301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:49.978695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3b9fc44b-f033-43ee-b354-2c3c07156301 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:49.979638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3b9fc44b-f033-43ee-b354-2c3c07156301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:49.993982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 959/1875] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:49.995311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fc44b-f033-43ee-b354-2c3c07156301 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.010264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fc44b-f033-43ee-b354-2c3c07156301 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.029149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920598ff465843a8b1e5529ecbf989fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:50.030594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.031308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.031631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.031860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.033503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:50.033863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.036257 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.061989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 960/1876] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:50.063691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.080032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22428636-89bd-4f0e-803d-37032241c28d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.088480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e8938-ace9-426c-92c8-0e1767d7e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.089318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8938-ace9-426c-92c8-0e1767d7e78c admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.089755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8938-ace9-426c-92c8-0e1767d7e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.090371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8938-ace9-426c-92c8-0e1767d7e78c admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.092565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e8938-ace9-426c-92c8-0e1767d7e78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.094740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e8938-ace9-426c-92c8-0e1767d7e78c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.100558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920598ff465843a8b1e5529ecbf989fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:50.117285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920598ff465843a8b1e5529ecbf989fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:50.117639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920598ff465843a8b1e5529ecbf989fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:50.118276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920598ff465843a8b1e5529ecbf989fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:50.142953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 917/1877] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:49 2022] DELETE /identity/v3/users/920598ff465843a8b1e5529ecbf989fb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:50.199821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 961/1878] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:50 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:50.204808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.206009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:50.272660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:50.333101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8dee1-20ee-4b14-aad2-a80f2beedc78 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.379134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.379672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.380400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.423889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] MFA Rules not processed for user `78b7a8d913d9417d820a9c429b1f1f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:50.429030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.429030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.429030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.429030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.429365 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.429446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:50.429919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.540925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 962/1879] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:50.545794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 918/1880] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:50 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:50.551170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.552138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.553809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:50.566712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c1e0f-f305-498c-ad4e-d3041790f9eb admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.576869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.580018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354a6bc-dc20-4a1d-b379-81d7eaa9865c None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.580142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.580142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.580142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.580142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.581562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.589179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.590141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.590695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.591201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.592082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.597018 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.602150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 919/1881] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:50.603923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.616030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d0a8-828e-44c8-b3a1-19d5b322df5b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.623029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.623888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.624178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.624524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.625297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.626957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.642913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 920/1882] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:50.645070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.655964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b7cd-d0e4-4f7b-ae1e-7a24cf23c3ba admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.661506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a5846-f329-4646-86ad-74ba6ae30ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.662461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5846-f329-4646-86ad-74ba6ae30ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.663454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5846-f329-4646-86ad-74ba6ae30ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.663847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5846-f329-4646-86ad-74ba6ae30ab3 admin admin] PATH_INFO: `/v3/projects/5f5e8803492a412dbbeb1a82d36c88e6/users/41b1f86ff0d54a90bdc8442cdbeda46d/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.689518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5846-f329-4646-86ad-74ba6ae30ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5e8803492a412dbbeb1a82d36c88e6, user_id=41b1f86ff0d54a90bdc8442cdbeda46d, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.692667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5846-f329-4646-86ad-74ba6ae30ab3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.711455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 963/1883] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:50 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:50.716334 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.819941 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94183e-7770-4a7e-bded-8e6cec6ac3ab admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:50.827132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:50.828071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.828509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.828959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.829876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:50.832312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:50.846870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 921/1884] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:50 2022] PUT /identity/v3/projects/5f5e8803492a412dbbeb1a82d36c88e6/users/41b1f86ff0d54a90bdc8442cdbeda46d/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:50.854677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78c41-a2f2-470a-b4b7-4044ea22a10a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:50.854989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78c41-a2f2-470a-b4b7-4044ea22a10a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:50.855451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78c41-a2f2-470a-b4b7-4044ea22a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:50.901957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-bca78c41-a2f2-470a-b4b7-4044ea22a10a None None] MFA Rules not processed for user `41b1f86ff0d54a90bdc8442cdbeda46d`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:50.903443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bca78c41-a2f2-470a-b4b7-4044ea22a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:50.984035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 964/1885] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:50 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:07:50.984035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.984035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:50.984618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 922/1886] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:50.984618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca78c41-a2f2-470a-b4b7-4044ea22a10a None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:50.994332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9299fc-c073-4eb7-a64b-40364c07bae7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.054886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca78c41-a2f2-470a-b4b7-4044ea22a10a None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.061174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.061863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.062190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.062633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.063403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.065069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.071548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.072865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.072865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.073072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] PATH_INFO: `/v3/projects/9f5ce551141842d089e8b5faa7ffaa7b` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.075794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5ce551141842d089e8b5faa7ffaa7b)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.081290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.081441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 923/1887] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:51.081441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.096287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b654a-53cb-4633-9e82-157a11f5c46e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.102920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.103647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.103939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.104390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.105179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.107734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.191704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5ce551141842d089e8b5faa7ffaa7b', 'request_id': 'req-079a8fc3-51ce-4571-913b-3b36f6a8510d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.197971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5ce551141842d089e8b5faa7ffaa7b', 'request_id': 'req-079a8fc3-51ce-4571-913b-3b36f6a8510d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.206245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:51.206369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 924/1888] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:51 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:51.206369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.206908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.208239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5ce551141842d089e8b5faa7ffaa7b', 'request_id': 'req-079a8fc3-51ce-4571-913b-3b36f6a8510d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.271594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788b5c0-046a-4a07-a2b2-6f307bf01d2c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.276267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.277129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.277413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.277691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] PATH_INFO: `/v3/projects/7720d96486a8413fa0f8695032d8bd8c` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.279455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7720d96486a8413fa0f8695032d8bd8c)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.284137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.311703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] The token cache is being invalidate because project 9f5ce551141842d089e8b5faa7ffaa7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:51.311998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.312654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.314327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 965/1889] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:50 2022] DELETE /identity/v3/projects/9f5ce551141842d089e8b5faa7ffaa7b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:51.315306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.316609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.384434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a8fc3-51ce-4571-913b-3b36f6a8510d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.389311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.390285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.390643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.391075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] PATH_INFO: `/v3/projects/7132ca9d80ca4059a44580211a2e18f7/users/2f157c6cbd0548a899d2d10fa44a4263/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.409575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7132ca9d80ca4059a44580211a2e18f7, user_id=2f157c6cbd0548a899d2d10fa44a4263, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.412983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.417597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7720d96486a8413fa0f8695032d8bd8c', 'request_id': 'req-7c21114a-85d6-45a8-8a13-b9e31d61bad1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.424559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7720d96486a8413fa0f8695032d8bd8c', 'request_id': 'req-7c21114a-85d6-45a8-8a13-b9e31d61bad1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.430548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7720d96486a8413fa0f8695032d8bd8c', 'request_id': 'req-7c21114a-85d6-45a8-8a13-b9e31d61bad1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.433860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:51.501972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 966/1890] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:51 2022] PUT /identity/v3/projects/7132ca9d80ca4059a44580211a2e18f7/users/2f157c6cbd0548a899d2d10fa44a4263/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:51.503262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.506326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.530017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] The token cache is being invalidate because project 7720d96486a8413fa0f8695032d8bd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:51.530312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.531133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.533438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 925/1891] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:51 2022] DELETE /identity/v3/projects/7720d96486a8413fa0f8695032d8bd8c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:51.533941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.536721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.583456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1a640-45e7-4339-99be-79c33337b1a3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.588986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.589722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.590096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.590440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.591800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.593781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.618309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21114a-85d6-45a8-8a13-b9e31d61bad1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.626016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.626999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.628599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.628599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] PATH_INFO: `/v3/users/2bf6857780bc45328aaacfa4c873fddf` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.630465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf6857780bc45328aaacfa4c873fddf)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.632764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.730717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 967/1892] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:51 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:51.730717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.732554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.744898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97f10-d73e-4dbd-9ed7-ffc339c31120 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.749885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7237f4-61d2-4935-a595-07def7004812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.750583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7237f4-61d2-4935-a595-07def7004812 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.756142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7237f4-61d2-4935-a595-07def7004812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.756142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7237f4-61d2-4935-a595-07def7004812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.756142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7237f4-61d2-4935-a595-07def7004812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.756142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7237f4-61d2-4935-a595-07def7004812 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.764802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 968/1893] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:51.766063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.766353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.766631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.785574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:51.786793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.794988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 969/1894] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:51.796039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.797377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.809321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313628a-2ced-4ae1-829c-abaf8ad2f6ca None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.814384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446babae-b095-473c-aa22-538e51178401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.815200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446babae-b095-473c-aa22-538e51178401 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.815367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446babae-b095-473c-aa22-538e51178401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.815648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446babae-b095-473c-aa22-538e51178401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.816374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446babae-b095-473c-aa22-538e51178401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.817966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446babae-b095-473c-aa22-538e51178401 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.828560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 970/1895] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:51.829355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446babae-b095-473c-aa22-538e51178401 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.838921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446babae-b095-473c-aa22-538e51178401 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.844300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697481bd-ce42-4083-a164-ccd16a47afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.845179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697481bd-ce42-4083-a164-ccd16a47afe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.845773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697481bd-ce42-4083-a164-ccd16a47afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.845773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697481bd-ce42-4083-a164-ccd16a47afe8 admin admin] PATH_INFO: `/v3/projects/7132ca9d80ca4059a44580211a2e18f7/users/2f157c6cbd0548a899d2d10fa44a4263/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.847792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697481bd-ce42-4083-a164-ccd16a47afe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7132ca9d80ca4059a44580211a2e18f7, user_id=2f157c6cbd0548a899d2d10fa44a4263, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.850393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697481bd-ce42-4083-a164-ccd16a47afe8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.862641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 971/1896] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:51 2022] PUT /identity/v3/projects/7132ca9d80ca4059a44580211a2e18f7/users/2f157c6cbd0548a899d2d10fa44a4263/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:51.864015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c38c5-fdde-421a-b714-4b99fa471a1f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.864307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c38c5-fdde-421a-b714-4b99fa471a1f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.864588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c38c5-fdde-421a-b714-4b99fa471a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.885191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b34c38c5-fdde-421a-b714-4b99fa471a1f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:51.886593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b34c38c5-fdde-421a-b714-4b99fa471a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.892429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf6857780bc45328aaacfa4c873fddf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.966993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 972/1897] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:51.971527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c38c5-fdde-421a-b714-4b99fa471a1f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.974338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf6857780bc45328aaacfa4c873fddf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.982505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c38c5-fdde-421a-b714-4b99fa471a1f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.984111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf6857780bc45328aaacfa4c873fddf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.987343 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf6857780bc45328aaacfa4c873fddf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.988205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf6857780bc45328aaacfa4c873fddf'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:51.989169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.990775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.991437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.992052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] PATH_INFO: `/v3/projects/3aa36c49ccae4a0985411cdd235f9793/users/1c6eef6f84b548849f4e406613fae43f/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.014854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa36c49ccae4a0985411cdd235f9793, user_id=1c6eef6f84b548849f4e406613fae43f, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.015056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 926/1898] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:51 2022] DELETE /identity/v3/users/2bf6857780bc45328aaacfa4c873fddf => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:52.015799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.017439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.017848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:52.089038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b764b1-4c14-4bff-9d0a-7ec1d6d1dfaf admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.094030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.096709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.097802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.098089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.100403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:52.100723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.104543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 973/1899] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:51 2022] PUT /identity/v3/projects/3aa36c49ccae4a0985411cdd235f9793/users/1c6eef6f84b548849f4e406613fae43f/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:52.105256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.108462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.110498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:52.134515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 927/1900] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:52.140002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.164819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88287ba-a45f-407c-a560-abcd5572cf8e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.204705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2f5d8-e664-4516-a01c-e51db56ef33a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.214293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.215024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.215331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.215614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.218528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.220348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.232623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 974/1901] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:52.237164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.251511 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.252187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.253031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.253321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.254507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.255278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84994128-0964-4e61-86c2-551352d3fcd8 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.258265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.267447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd6d9c-845b-45ab-bbd3-f6b57ea3f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.268932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd6d9c-845b-45ab-bbd3-f6b57ea3f68c admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.269398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd6d9c-845b-45ab-bbd3-f6b57ea3f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.269899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd6d9c-845b-45ab-bbd3-f6b57ea3f68c admin admin] PATH_INFO: `/v3/projects/3aa36c49ccae4a0985411cdd235f9793/users/1c6eef6f84b548849f4e406613fae43f/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.272640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd6d9c-845b-45ab-bbd3-f6b57ea3f68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa36c49ccae4a0985411cdd235f9793, user_id=1c6eef6f84b548849f4e406613fae43f, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.277457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd6d9c-845b-45ab-bbd3-f6b57ea3f68c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.301967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 975/1902] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:52 2022] PUT /identity/v3/projects/3aa36c49ccae4a0985411cdd235f9793/users/1c6eef6f84b548849f4e406613fae43f/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:52.303670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.303965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.304229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.353688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] MFA Rules not processed for user `1c6eef6f84b548849f4e406613fae43f`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:52.359070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:52.361533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 928/1903] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:52 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:52.366298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.473499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:52.504103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 976/1904] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:52.505856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91a77-c104-470a-a032-7fe76ba26203 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.515397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.516085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.516372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.516658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.517429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.518757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.519330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.520946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:52.609163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273518b-f3bb-405f-a88e-1374d24d3190 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.634011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 929/1905] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:52 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:52.635078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.647131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1d8b-ba0d-4950-98d0-6364f091e0dd admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.653162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.655616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.656052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.656603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.661011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.665825 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.674656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.675243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.675534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.675820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.713680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 930/1906] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:52.716697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.742621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0a1e6-b4b4-410b-b0d7-428ff239343f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.756100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.757052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.757435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.758399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.759590 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.764451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.792473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 931/1907] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:52.796086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.811851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.813818 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.819299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966365a2-4826-4ad2-bcd7-3e90e6297403 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.832677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.835998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.836530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.837980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] PATH_INFO: `/v3/projects/d69b74903a414388aec418dcd3798278/users/e0cf8cd026a648ca88a5fb5692e9e950/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.845103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 977/1908] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:52.847808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:52.853524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:52.875762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69b74903a414388aec418dcd3798278, user_id=e0cf8cd026a648ca88a5fb5692e9e950, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.888484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6f1ba-a040-469c-8a39-d9f88966ff45 service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:52.888922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:52.907601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:52.915836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:52.915836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:52.915836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] PATH_INFO: `/v3/projects/6fd21e908c79483a9d1815f34c3c1c70` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:52.915836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd21e908c79483a9d1815f34c3c1c70)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:52.920454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:53.034355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 932/1909] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:52 2022] PUT /identity/v3/projects/d69b74903a414388aec418dcd3798278/users/e0cf8cd026a648ca88a5fb5692e9e950/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:53.035813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:53.071945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd21e908c79483a9d1815f34c3c1c70', 'request_id': 'req-674a47c5-74dd-4955-8e34-82d088469597'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.081075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd21e908c79483a9d1815f34c3c1c70', 'request_id': 'req-674a47c5-74dd-4955-8e34-82d088469597'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.088357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd21e908c79483a9d1815f34c3c1c70', 'request_id': 'req-674a47c5-74dd-4955-8e34-82d088469597'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.143274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663b3e-6ee8-43bb-9ffb-e2a0f8d5c7bf admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:53.197858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] The token cache is being invalidate because project 6fd21e908c79483a9d1815f34c3c1c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:53.197858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.200654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-674a47c5-74dd-4955-8e34-82d088469597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.208642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 978/1910] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:52 2022] DELETE /identity/v3/projects/6fd21e908c79483a9d1815f34c3c1c70 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:53.208642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b1af-5e44-47eb-bd36-52f40114a0c1 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.208642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b1af-5e44-47eb-bd36-52f40114a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.208642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b1af-5e44-47eb-bd36-52f40114a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.235133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:53.237048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.237400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.237756 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] PATH_INFO: `/v3/users/41b1f86ff0d54a90bdc8442cdbeda46d` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.239137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b1f86ff0d54a90bdc8442cdbeda46d)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:53.241480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:53.245575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8513b1af-5e44-47eb-bd36-52f40114a0c1 None None] MFA Rules not processed for user `e0cf8cd026a648ca88a5fb5692e9e950`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:53.247544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8513b1af-5e44-47eb-bd36-52f40114a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.350877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 979/1911] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:53.351891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7bc67-686a-4da9-8c51-d3a92c3d38d5 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.351891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7bc67-686a-4da9-8c51-d3a92c3d38d5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.352156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7bc67-686a-4da9-8c51-d3a92c3d38d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.359718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:53.377055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8bd7bc67-686a-4da9-8c51-d3a92c3d38d5 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:53.378257 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8bd7bc67-686a-4da9-8c51-d3a92c3d38d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.398947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 980/1912] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:53.400438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae6554-cc38-406e-907f-6a8e2d9dc49d None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.400738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae6554-cc38-406e-907f-6a8e2d9dc49d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.401016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae6554-cc38-406e-907f-6a8e2d9dc49d None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.406886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 981/1913] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:53.406886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae6554-cc38-406e-907f-6a8e2d9dc49d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:53.413308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3cae6554-cc38-406e-907f-6a8e2d9dc49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.428750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae6554-cc38-406e-907f-6a8e2d9dc49d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:53.435281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1a87d-bb70-4c1c-81bb-73caf335550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:53.436108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a87d-bb70-4c1c-81bb-73caf335550b admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.436482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a87d-bb70-4c1c-81bb-73caf335550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.436828 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a87d-bb70-4c1c-81bb-73caf335550b admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.437596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1a87d-bb70-4c1c-81bb-73caf335550b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:53.439607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1a87d-bb70-4c1c-81bb-73caf335550b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:53.469016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b1f86ff0d54a90bdc8442cdbeda46d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.536026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 982/1914] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:53.538106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a216a-8e65-4a6b-bb18-3596f7d27850 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.538397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a216a-8e65-4a6b-bb18-3596f7d27850 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.538678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a216a-8e65-4a6b-bb18-3596f7d27850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.557966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b1f86ff0d54a90bdc8442cdbeda46d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.560058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-439a216a-8e65-4a6b-bb18-3596f7d27850 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:53.561297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-439a216a-8e65-4a6b-bb18-3596f7d27850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.565929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b1f86ff0d54a90bdc8442cdbeda46d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.566799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b1f86ff0d54a90bdc8442cdbeda46d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.568152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ce38ee8d-bd87-4f25-8858-d67bf44faa5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b1f86ff0d54a90bdc8442cdbeda46d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:53.590373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 933/1915] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:53 2022] DELETE /identity/v3/users/41b1f86ff0d54a90bdc8442cdbeda46d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:53.592453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.592753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.593034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.624162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] MFA Rules not processed for user `2f157c6cbd0548a899d2d10fa44a4263`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:53.625404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.630463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 983/1916] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:53.631908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19383f76-6c39-4214-bd84-3601186d6978 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.632201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19383f76-6c39-4214-bd84-3601186d6978 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.632482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19383f76-6c39-4214-bd84-3601186d6978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.654404 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-19383f76-6c39-4214-bd84-3601186d6978 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:53.655698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-19383f76-6c39-4214-bd84-3601186d6978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.689855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:53.707289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 934/1917] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:53.708500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:53.710616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.748172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 984/1918] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:53.749328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498b6c-f495-4ed6-966f-288cb5475df0 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.749625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498b6c-f495-4ed6-966f-288cb5475df0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.749913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498b6c-f495-4ed6-966f-288cb5475df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.769310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5b498b6c-f495-4ed6-966f-288cb5475df0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:53.770527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5b498b6c-f495-4ed6-966f-288cb5475df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.804919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef62f-849c-484b-a738-8e1fed2721e1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:53.810306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:53.810955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.811242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.811579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.812349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:53.814295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:53.837904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 985/1919] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:53.838779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498b6c-f495-4ed6-966f-288cb5475df0 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:53.849149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b498b6c-f495-4ed6-966f-288cb5475df0 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:53.854637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:53.855646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.855956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.856784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.857576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:53.857859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:53.859697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:53.873486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 986/1920] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:53.874659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:53.878450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.910236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 935/1921] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:53 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:53.915986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:53.918007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.943003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802ee44-240f-4049-a02f-c261c7fa4190 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:53.956108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:53.956793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.957170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.957459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.958680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a598a-a8b7-41c4-8196-1806c1f2e099 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:53.963591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:53.964416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.964771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.965059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.967009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.974493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:53.976488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:53.998449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 936/1922] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:53.999503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.002763 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:54.045185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:54.078735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.081337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.096230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e7fed-4f13-4af8-b1ca-19eb1645ebb7 service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.099000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 987/1923] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:54.100118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.100334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.101067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.104151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.104151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.116132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b875f-ff34-4d97-ac2c-810987286647 service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.123881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.127009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.127009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.127009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.127770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.127880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.129542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.130012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.160405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 937/1924] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:54.161577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.193933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4940-19f5-42b8-8313-edbcd22ff58e service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.208372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.209178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.209571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.209956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.210816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.217679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.236181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 988/1925] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:54 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:54.239783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.263549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 938/1926] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:54.271252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.298250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8aa1-a0e1-428d-8199-7e7a09dcbdc0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.331010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:54.350680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e6bd0-8578-4f84-b59b-e859cd356fe6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.360959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.363052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.363575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.365149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.367496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.369926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.388739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.391881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.392399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.395430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.395430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.398173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.416950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 939/1927] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:54.416950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.444454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdad38c-cdad-4391-bc74-5f7b9f7950ab admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.450011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf7e1f-4331-4366-bc69-f748aeb16c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.451320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf7e1f-4331-4366-bc69-f748aeb16c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.451572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf7e1f-4331-4366-bc69-f748aeb16c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.451964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf7e1f-4331-4366-bc69-f748aeb16c4f admin admin] PATH_INFO: `/v3/projects/8dcfd94986794659873657adc1508e3b/users/cc3de8288c674248becc96d0c53654ef/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.479422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 989/1928] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:54 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:07:54.480517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.502286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf7e1f-4331-4366-bc69-f748aeb16c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcfd94986794659873657adc1508e3b, user_id=cc3de8288c674248becc96d0c53654ef, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.506454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997579c0-1188-4813-95ec-5939b902e333 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.508521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf7e1f-4331-4366-bc69-f748aeb16c4f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.520046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.521067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.521851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.522243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.523368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.526098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.540979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 990/1929] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:54.542117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.554651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541c774-bbac-4cc6-9502-cd6aabbc662c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.561363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.562970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.563903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.564276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.565131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.567668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.587531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 991/1930] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:54.588553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.604989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0619-e38c-4495-9373-9bc23c692c4a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.611651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.612773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.626032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.626668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] PATH_INFO: `/v3/projects/0d91fe94fc6d4d42a2718d3c89d7d39c/users/c90a25a42ca94df1939e7a902d00ef56/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.658301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 940/1931] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:54 2022] PUT /identity/v3/projects/8dcfd94986794659873657adc1508e3b/users/cc3de8288c674248becc96d0c53654ef/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:54.671077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462a5c-f359-4dd1-888e-d2b5add3d4f3 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.671490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462a5c-f359-4dd1-888e-d2b5add3d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.671876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462a5c-f359-4dd1-888e-d2b5add3d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.689492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d91fe94fc6d4d42a2718d3c89d7d39c, user_id=c90a25a42ca94df1939e7a902d00ef56, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.693401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:54.725067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-58462a5c-f359-4dd1-888e-d2b5add3d4f3 None None] MFA Rules not processed for user `cc3de8288c674248becc96d0c53654ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:54.726433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-58462a5c-f359-4dd1-888e-d2b5add3d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:54.812878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 941/1932] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:54.817209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58462a5c-f359-4dd1-888e-d2b5add3d4f3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:54.879015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58462a5c-f359-4dd1-888e-d2b5add3d4f3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:54.883892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0732f-addb-46a9-a19f-af10c5962b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:54.884566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0732f-addb-46a9-a19f-af10c5962b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:54.884907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0732f-addb-46a9-a19f-af10c5962b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:54.885188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0732f-addb-46a9-a19f-af10c5962b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:54.885881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0732f-addb-46a9-a19f-af10c5962b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:54.888404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0732f-addb-46a9-a19f-af10c5962b30 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.013437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 992/1933] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:54 2022] PUT /identity/v3/projects/0d91fe94fc6d4d42a2718d3c89d7d39c/users/c90a25a42ca94df1939e7a902d00ef56/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:55.014063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.031778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:55.040986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 942/1934] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:54 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:07:55.045606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cedf8-2f3f-45de-af3b-7f40bace85ee None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.046292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cedf8-2f3f-45de-af3b-7f40bace85ee None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.046292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cedf8-2f3f-45de-af3b-7f40bace85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.099539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a64cedf8-2f3f-45de-af3b-7f40bace85ee None None] MFA Rules not processed for user `c90a25a42ca94df1939e7a902d00ef56`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:55.100866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a64cedf8-2f3f-45de-af3b-7f40bace85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:55.113634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ebb16-94da-47a0-ad29-cafe3b8cc20f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.180111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.181113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.181402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.181680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] PATH_INFO: `/v3/projects/5f5e8803492a412dbbeb1a82d36c88e6` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.183152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 943/1935] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:55.183279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5e8803492a412dbbeb1a82d36c88e6)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.183740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cedf8-2f3f-45de-af3b-7f40bace85ee None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.192679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.195034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cedf8-2f3f-45de-af3b-7f40bace85ee None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.201157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.201878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.202169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.202446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.203165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.205089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.315146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 944/1936] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:55 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:55.315146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.317323 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:55.338482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5e8803492a412dbbeb1a82d36c88e6', 'request_id': 'req-afa481e9-ed7b-442a-89e5-062b7a15991c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.345099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5e8803492a412dbbeb1a82d36c88e6', 'request_id': 'req-afa481e9-ed7b-442a-89e5-062b7a15991c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.366952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5e8803492a412dbbeb1a82d36c88e6', 'request_id': 'req-afa481e9-ed7b-442a-89e5-062b7a15991c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.387633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913adb3-e986-4df4-a419-d0bcdad63d0d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.426109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] The token cache is being invalidate because project 5f5e8803492a412dbbeb1a82d36c88e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:55.426447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.427109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.429066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 993/1937] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:55 2022] DELETE /identity/v3/projects/5f5e8803492a412dbbeb1a82d36c88e6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:55.429887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.431647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:55.439091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.441727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.441727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.441727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.443247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:55.508206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa481e9-ed7b-442a-89e5-062b7a15991c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.513193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.513895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.514180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.514294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.514461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.515284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.515928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.516935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.525560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 945/1938] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:55.532380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.532518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 994/1939] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:55.532650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:55.532742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.541545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c3f9e-a24a-486d-97f7-cfa3f57cdac2 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.541693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58032ebd-e55a-44b5-bc3b-60f046a66ec2 service glance] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.546813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.547340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.548157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.548282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.548497 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.548605 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.548776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] PATH_INFO: `/v3/projects/9469c72d3293410f99b3b600e70fd49a/users/b103f79be4c040c18985cdaa1118162e/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.548885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] PATH_INFO: `/v3/users/1c6eef6f84b548849f4e406613fae43f` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.550269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6eef6f84b548849f4e406613fae43f)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.552145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.566216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9469c72d3293410f99b3b600e70fd49a, user_id=b103f79be4c040c18985cdaa1118162e, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.568922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.651139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 995/1940] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:55 2022] PUT /identity/v3/projects/9469c72d3293410f99b3b600e70fd49a/users/b103f79be4c040c18985cdaa1118162e/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:55.655568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.733734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a50b3-3e9e-463f-9969-164cae8f6d25 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.757426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.758122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.758420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.758696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.759458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.762815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.775026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6eef6f84b548849f4e406613fae43f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.791916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 996/1941] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:55.791916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.803979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57ce00-bc5f-4fbb-8d0c-b7ae13e0eb6a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:55.808599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fa5fc-59f2-4f2b-924f-caef5b421f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:55.809675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa5fc-59f2-4f2b-924f-caef5b421f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.809960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa5fc-59f2-4f2b-924f-caef5b421f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.810239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa5fc-59f2-4f2b-924f-caef5b421f09 admin admin] PATH_INFO: `/v3/projects/9469c72d3293410f99b3b600e70fd49a/users/b103f79be4c040c18985cdaa1118162e/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.812330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fa5fc-59f2-4f2b-924f-caef5b421f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9469c72d3293410f99b3b600e70fd49a, user_id=b103f79be4c040c18985cdaa1118162e, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:55.815163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fa5fc-59f2-4f2b-924f-caef5b421f09 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:55.827457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 997/1942] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:55 2022] PUT /identity/v3/projects/9469c72d3293410f99b3b600e70fd49a/users/b103f79be4c040c18985cdaa1118162e/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:55.842478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.842766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.843077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.854645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6eef6f84b548849f4e406613fae43f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.865179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6eef6f84b548849f4e406613fae43f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.866517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6eef6f84b548849f4e406613fae43f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.867809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6eef6f84b548849f4e406613fae43f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:55.875883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] MFA Rules not processed for user `b103f79be4c040c18985cdaa1118162e`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:55.877654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:55.886285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 946/1943] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:55 2022] DELETE /identity/v3/users/1c6eef6f84b548849f4e406613fae43f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:55.941861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:55.953876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 998/1944] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:55.966171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:55.968221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.004265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:56.032651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6784574-0cc5-4e10-929d-d46a7320555f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:56.033866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:56.034516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:56.034796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:56.035105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:56.036993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.101649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:56.102652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:56.112314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 947/1945] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:56.303831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:56.305488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.465493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:56.465616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0fee6-de1a-4644-a8d7-fe8f1b86899a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:56.467195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.482394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca80531-8c7c-4cb6-9e31-5f7571fae571 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:56.492034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de8ec6-1193-4268-834e-2912ca33e709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:56.495656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de8ec6-1193-4268-834e-2912ca33e709 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:56.495656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de8ec6-1193-4268-834e-2912ca33e709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:56.495974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de8ec6-1193-4268-834e-2912ca33e709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:56.505091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f9de8ec6-1193-4268-834e-2912ca33e709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.574257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:56.600146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:56.601783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:56.601993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:56.602492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] PATH_INFO: `/v3/projects/3aa36c49ccae4a0985411cdd235f9793` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:56.604357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa36c49ccae4a0985411cdd235f9793)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:56.607468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:56.658132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de8ec6-1193-4268-834e-2912ca33e709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:56.659716 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de8ec6-1193-4268-834e-2912ca33e709 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:56.669923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 948/1946] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:56.738519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa36c49ccae4a0985411cdd235f9793', 'request_id': 'req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.745490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa36c49ccae4a0985411cdd235f9793', 'request_id': 'req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.752318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa36c49ccae4a0985411cdd235f9793', 'request_id': 'req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.829572 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] The token cache is being invalidate because project 3aa36c49ccae4a0985411cdd235f9793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:56.829881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.830626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-1747e8f6-0dbc-4af2-bd9f-cc324f4b2948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.832253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 999/1947] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:56 2022] DELETE /identity/v3/projects/3aa36c49ccae4a0985411cdd235f9793 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:56.839960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c93e-30dc-488a-aabc-4fb11388a3b5 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:56.844303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c93e-30dc-488a-aabc-4fb11388a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:56.844303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c93e-30dc-488a-aabc-4fb11388a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:56.889877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-ff27c93e-30dc-488a-aabc-4fb11388a3b5 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:56.896001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ff27c93e-30dc-488a-aabc-4fb11388a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:57.023007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 949/1948] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:57.033355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1966-cf8b-4e90-9905-6c646a4bfa26 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.036927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:57.037229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1966-cf8b-4e90-9905-6c646a4bfa26 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.037973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1966-cf8b-4e90-9905-6c646a4bfa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.077468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-368c1966-cf8b-4e90-9905-6c646a4bfa26 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:57.079011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-368c1966-cf8b-4e90-9905-6c646a4bfa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:57.111708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1000/1949] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:57.120513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c93e-30dc-488a-aabc-4fb11388a3b5 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:57.131760 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c93e-30dc-488a-aabc-4fb11388a3b5 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.143505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.144343 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.144690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.144987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.145816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:57.146136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.147834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.160846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 950/1950] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:57.166260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1966-cf8b-4e90-9905-6c646a4bfa26 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:57.177280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1966-cf8b-4e90-9905-6c646a4bfa26 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.182250 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.182928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.183214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.183491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.195874 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.198144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.325885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1001/1951] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:57 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:57.403500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:57.421894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4603ae-0323-48be-9d5d-5d5570da8a83 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.481053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.482695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.482991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.483296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.484015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.486338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.574520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 951/1952] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:57 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:57.579188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:57.589859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181d5e-ef92-455b-81fb-f8757dfc203a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.595495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.596171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.596599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.596891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.597627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.599264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.610878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1002/1953] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:57.614995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:57.625188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6643b9-cebf-421e-9e34-a9e7f36012ce admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.629943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befae201-4949-4d5a-a832-9df033f25c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.630599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befae201-4949-4d5a-a832-9df033f25c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.630924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befae201-4949-4d5a-a832-9df033f25c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.631207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befae201-4949-4d5a-a832-9df033f25c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.631936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befae201-4949-4d5a-a832-9df033f25c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.633521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befae201-4949-4d5a-a832-9df033f25c20 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.644279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 952/1954] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:57.648421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:57.659370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eac6f-92b4-470f-826f-b4e1e90f3344 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.663954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.664908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.665198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.665483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] PATH_INFO: `/v3/projects/e381346391cf4060932af3195c0756c7/users/7502bd90afbf4c8db991f050f13ae111/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.680838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e381346391cf4060932af3195c0756c7, user_id=7502bd90afbf4c8db991f050f13ae111, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.684017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.832119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1003/1955] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:57 2022] PUT /identity/v3/projects/e381346391cf4060932af3195c0756c7/users/7502bd90afbf4c8db991f050f13ae111/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:57.846976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cb5d-dd73-4c9e-b275-f281d0ac282e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.846976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cb5d-dd73-4c9e-b275-f281d0ac282e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.846976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cb5d-dd73-4c9e-b275-f281d0ac282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.870621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9588cb5d-dd73-4c9e-b275-f281d0ac282e None None] MFA Rules not processed for user `7502bd90afbf4c8db991f050f13ae111`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:57.871983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9588cb5d-dd73-4c9e-b275-f281d0ac282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:57.964626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 953/1956] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:57.968869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.035874 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adc71-cfdc-4652-b3e9-201a6fd2f806 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.040694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.041597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.042003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.042291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.043024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.045935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.153358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1004/1957] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:57 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:58.157474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588cb5d-dd73-4c9e-b275-f281d0ac282e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.170176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588cb5d-dd73-4c9e-b275-f281d0ac282e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.244471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.249882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.249882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.249882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.249882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.249882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.392477 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 954/1958] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:58 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:58.393297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.404586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78be04-1100-4d39-8381-551b82ea6b4e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.409290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.410027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.410247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.410526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.411304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.417390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.429585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1005/1959] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:58.433423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.456959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bd3c9-e538-411d-bc24-2dd588a07253 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.468895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.468895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.468895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.468895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] PATH_INFO: `/v3/projects/c80d2fcfa4ef459999dbe8fc9f24bb30/users/3ae34bbd83794613a66438f89ed21803/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.480267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80d2fcfa4ef459999dbe8fc9f24bb30, user_id=3ae34bbd83794613a66438f89ed21803, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.483512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.633152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 955/1960] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:58 2022] PUT /identity/v3/projects/c80d2fcfa4ef459999dbe8fc9f24bb30/users/3ae34bbd83794613a66438f89ed21803/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:58.637281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.645770 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:58.649798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddda12-b7aa-4c4e-9bd0-c18727170dc6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.709039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5332b4-9871-47a7-9403-1064cd39496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.709808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5332b4-9871-47a7-9403-1064cd39496e admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.710096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5332b4-9871-47a7-9403-1064cd39496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.710408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5332b4-9871-47a7-9403-1064cd39496e admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.711225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5332b4-9871-47a7-9403-1064cd39496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.712831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5332b4-9871-47a7-9403-1064cd39496e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.726034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1006/1961] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:58.727926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.739492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989540-5b70-4f8e-adbc-df0cb0e875b8 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.744302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.745424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.745669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.745930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] PATH_INFO: `/v3/projects/c80d2fcfa4ef459999dbe8fc9f24bb30/users/3ae34bbd83794613a66438f89ed21803/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.748231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80d2fcfa4ef459999dbe8fc9f24bb30, user_id=3ae34bbd83794613a66438f89ed21803, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.751031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.761543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 956/1962] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:58 2022] PUT /identity/v3/projects/c80d2fcfa4ef459999dbe8fc9f24bb30/users/3ae34bbd83794613a66438f89ed21803/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:58.774488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcac28-e6df-4481-b7bc-55e9b69f26c6 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.774782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcac28-e6df-4481-b7bc-55e9b69f26c6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.775529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcac28-e6df-4481-b7bc-55e9b69f26c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.810481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-89fcac28-e6df-4481-b7bc-55e9b69f26c6 None None] MFA Rules not processed for user `3ae34bbd83794613a66438f89ed21803`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:58.810481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-89fcac28-e6df-4481-b7bc-55e9b69f26c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:58.915687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1007/1963] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:07:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:58.936198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.939137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.068496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da798d-0c3f-4163-835f-486112c1c4e5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.068496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.068496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.068496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.069065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.070794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.076555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.114701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 957/1964] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:59.241710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcac28-e6df-4481-b7bc-55e9b69f26c6 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:59.253233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcac28-e6df-4481-b7bc-55e9b69f26c6 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.258134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.259207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.259675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.260039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.361296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.361658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.369382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:59.380422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1008/1965] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:59.403425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:59.405381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.417510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211cb2-d0c6-4ac8-8509-680031e1e9ae service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.421503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.422273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.422758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.423146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.425254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.526932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.528609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.552936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 958/1966] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:00.660131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:00.723569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:01.082343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:01.092339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6129bb-dfa3-4a07-9557-3aa547308b4c service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:01.096907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c5f7-f223-4f66-baa0-05d9c432f019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:01.097808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c5f7-f223-4f66-baa0-05d9c432f019 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:01.098656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c5f7-f223-4f66-baa0-05d9c432f019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:01.099107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c5f7-f223-4f66-baa0-05d9c432f019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:01.103210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c708c5f7-f223-4f66-baa0-05d9c432f019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:01.188868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708c5f7-f223-4f66-baa0-05d9c432f019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:01.190423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708c5f7-f223-4f66-baa0-05d9c432f019 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:01.204278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1009/1967] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:02.003052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:02.077260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:02.959087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:03.014938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:03.067358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:03.137952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401dc94-e420-44ce-a22f-5e98bc6e366f service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:03.143720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:03.145936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:03.145936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:03.145936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] PATH_INFO: `/v3/users/7502bd90afbf4c8db991f050f13ae111` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:03.146994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7502bd90afbf4c8db991f050f13ae111)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:03.149013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:03.394473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7502bd90afbf4c8db991f050f13ae111'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:03.460387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7502bd90afbf4c8db991f050f13ae111'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:03.469087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7502bd90afbf4c8db991f050f13ae111'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:03.469786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7502bd90afbf4c8db991f050f13ae111'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:03.470407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7502bd90afbf4c8db991f050f13ae111'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:03.494093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 959/1968] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:03 2022] DELETE /identity/v3/users/7502bd90afbf4c8db991f050f13ae111 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:03.497535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:03.497535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:03.497535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:03.515758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:03.517058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:03.605714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1010/1969] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:03.614159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:03.615591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:03.688668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850bff-d92a-4f4f-b309-89fa80c24c74 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:03.693040 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:03.693768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:03.694061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:03.694343 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:03.705888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:03.707471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:03.719236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 960/1970] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:04.151381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:04.264548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:04.266453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:04.277679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:04.280211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97089-1872-425e-99bf-be1710e539d9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:04.286684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:04.287758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:04.288119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:04.288476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] PATH_INFO: `/v3/projects/e381346391cf4060932af3195c0756c7` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:04.289943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e381346391cf4060932af3195c0756c7)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:04.291970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:04.420600 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e381346391cf4060932af3195c0756c7', 'request_id': 'req-94288040-f28c-493f-9c0a-686cb94a23f1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.426630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e381346391cf4060932af3195c0756c7', 'request_id': 'req-94288040-f28c-493f-9c0a-686cb94a23f1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.432147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e381346391cf4060932af3195c0756c7', 'request_id': 'req-94288040-f28c-493f-9c0a-686cb94a23f1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.504517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] The token cache is being invalidate because project e381346391cf4060932af3195c0756c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:04.505164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.505564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.507265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1011/1971] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:04 2022] DELETE /identity/v3/projects/e381346391cf4060932af3195c0756c7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:04.511341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:04.520758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482b94-4056-478e-afad-3e27d5e3b14f service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:04.580347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:04.581197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:04.581481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:04.581768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] PATH_INFO: `/v3/users/3ae34bbd83794613a66438f89ed21803` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:04.583009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae34bbd83794613a66438f89ed21803)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:04.584954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:04.825941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae34bbd83794613a66438f89ed21803'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.837127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:04.916618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae34bbd83794613a66438f89ed21803'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.932819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae34bbd83794613a66438f89ed21803'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.942045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae34bbd83794613a66438f89ed21803'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.942045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-4cfade17-aac4-436a-9882-d5b734e7128b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae34bbd83794613a66438f89ed21803'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:04.949450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:04.962390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 961/1972] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:04 2022] DELETE /identity/v3/users/3ae34bbd83794613a66438f89ed21803 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:05.300225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:05.422075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:05.423746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:05.439854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288040-f28c-493f-9c0a-686cb94a23f1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:05.500247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:05.501111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:05.501461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:05.501747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] PATH_INFO: `/v3/projects/c80d2fcfa4ef459999dbe8fc9f24bb30` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:05.502964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80d2fcfa4ef459999dbe8fc9f24bb30)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:05.504855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:05.564166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:05.615782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80d2fcfa4ef459999dbe8fc9f24bb30', 'request_id': 'req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:05.623481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80d2fcfa4ef459999dbe8fc9f24bb30', 'request_id': 'req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:05.628855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80d2fcfa4ef459999dbe8fc9f24bb30', 'request_id': 'req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:05.699336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] The token cache is being invalidate because project c80d2fcfa4ef459999dbe8fc9f24bb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:05.700279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:05.700969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7b2dc456-7f8a-40b3-8cdf-8df16c589b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:05.702753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1012/1973] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:05 2022] DELETE /identity/v3/projects/c80d2fcfa4ef459999dbe8fc9f24bb30 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:05.707993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398bb0-abb5-42e0-8147-87f835c014f9 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:05.708922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398bb0-abb5-42e0-8147-87f835c014f9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:05.709534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398bb0-abb5-42e0-8147-87f835c014f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:05.735690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a7398bb0-abb5-42e0-8147-87f835c014f9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:05.736912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a7398bb0-abb5-42e0-8147-87f835c014f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:05.813543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 962/1974] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:05.821548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d0650-f476-4004-9c09-9ad990093148 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:05.821847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d0650-f476-4004-9c09-9ad990093148 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:05.822131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d0650-f476-4004-9c09-9ad990093148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:05.847551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e65d0650-f476-4004-9c09-9ad990093148 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:05.856060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e65d0650-f476-4004-9c09-9ad990093148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:05.858219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1013/1975] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:05.862364 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7398bb0-abb5-42e0-8147-87f835c014f9 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:05.881559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7398bb0-abb5-42e0-8147-87f835c014f9 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:05.893592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:05.894365 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:05.894721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:05.895268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:05.896672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:05.897302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:05.899031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:05.912066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 963/1976] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:05.916436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d0650-f476-4004-9c09-9ad990093148 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:05.926218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d0650-f476-4004-9c09-9ad990093148 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:05.931903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:05.932585 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:05.932898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:05.933145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:05.933893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:05.935931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.013422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1014/1977] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:05 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:06.014528 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.024834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294837-d130-48c3-897c-9e5d0200a454 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.092108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.092108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.092318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.092554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.093245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.095287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.174384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 964/1978] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:06 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:06.178387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.189200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4459-9c0b-42bb-846b-39be98771a88 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.193907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.194569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.194881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.195161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.195884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.197472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.210443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1015/1979] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:06.214380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.225126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a202b-b732-4fb7-88df-089594edb921 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.230125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5829c-1919-43de-8772-7536bbe73e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.231359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5829c-1919-43de-8772-7536bbe73e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.231645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5829c-1919-43de-8772-7536bbe73e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.231928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5829c-1919-43de-8772-7536bbe73e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.232652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5829c-1919-43de-8772-7536bbe73e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.234252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5829c-1919-43de-8772-7536bbe73e17 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.250111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 965/1980] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:06.253384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.256100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:06.267312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c95de-3182-4503-a939-7d6e435a75c4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.278895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.280068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.280864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.281309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] PATH_INFO: `/v3/projects/2962e9b1bd6a43fa81974551c22d4043/users/09ed90ff24df46e69977f46181bc20e5/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.299038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2962e9b1bd6a43fa81974551c22d4043, user_id=09ed90ff24df46e69977f46181bc20e5, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.303138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.346268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:06.356219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1016/1981] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:06 2022] PUT /identity/v3/projects/2962e9b1bd6a43fa81974551c22d4043/users/09ed90ff24df46e69977f46181bc20e5/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:06.366790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260cd02-1e49-4032-baec-95c7baf0394c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.367174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260cd02-1e49-4032-baec-95c7baf0394c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.370098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260cd02-1e49-4032-baec-95c7baf0394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.401623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e260cd02-1e49-4032-baec-95c7baf0394c None None] MFA Rules not processed for user `09ed90ff24df46e69977f46181bc20e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:06.401623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e260cd02-1e49-4032-baec-95c7baf0394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:06.468296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 966/1982] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:06.472813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.535955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8560-3c24-4dac-8599-5426b19cfdf9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.540897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.541558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.541846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.542124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.542814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.545335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.655962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1017/1983] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:06 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:06.659998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260cd02-1e49-4032-baec-95c7baf0394c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.673373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260cd02-1e49-4032-baec-95c7baf0394c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.735060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.735731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.736015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.736291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.736994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.739020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.785871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:06.846892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 967/1984] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:06 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:06.848296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.864456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409a336-7e13-49ae-b051-d26dbfe2e9d4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.865383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.866111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.866540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.866866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.867601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.869233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.881836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1018/1985] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:06.891398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:06.896810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795791c-d6ad-4d46-af94-589ea868ed8c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:06.901416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:06.903049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:06.903284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:06.903674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] PATH_INFO: `/v3/projects/e622084a5732482785186bd890ff4cc3/users/c65baf3c7c99459096393688c6674654/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:06.920678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e622084a5732482785186bd890ff4cc3, user_id=c65baf3c7c99459096393688c6674654, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:06.923416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:06.969514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:07.032455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 968/1986] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:06 2022] PUT /identity/v3/projects/e622084a5732482785186bd890ff4cc3/users/c65baf3c7c99459096393688c6674654/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:07.037896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:07.049417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b275535-a000-45ef-9c44-0fe54750ebcf admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:07.107332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b41a4-4d99-42d1-891b-b7705e4d5425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:07.108031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b41a4-4d99-42d1-891b-b7705e4d5425 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:07.108327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b41a4-4d99-42d1-891b-b7705e4d5425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:07.108800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b41a4-4d99-42d1-891b-b7705e4d5425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:07.109540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b41a4-4d99-42d1-891b-b7705e4d5425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:07.111238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b41a4-4d99-42d1-891b-b7705e4d5425 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:07.121976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1019/1987] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:07.126444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:07.144326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8127d14-d57d-42d6-a6e3-1c4e95b7752b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:07.154956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:07.154956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:07.154956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:07.154956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] PATH_INFO: `/v3/projects/e622084a5732482785186bd890ff4cc3/users/c65baf3c7c99459096393688c6674654/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:07.155455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e622084a5732482785186bd890ff4cc3, user_id=c65baf3c7c99459096393688c6674654, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:07.156037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:07.167287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 969/1988] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:07 2022] PUT /identity/v3/projects/e622084a5732482785186bd890ff4cc3/users/c65baf3c7c99459096393688c6674654/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:07.178524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:07.178814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:07.179125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:07.208435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] MFA Rules not processed for user `c65baf3c7c99459096393688c6674654`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:07.209693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:07.290502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1020/1989] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:07.335398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:07.351028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:07.352974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:07.421337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd8100-f3ec-4fde-94ab-e5da64f5645b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:07.425231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74503ba-8964-41fd-baef-fb8bd0e3c9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:07.425991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74503ba-8964-41fd-baef-fb8bd0e3c9dc service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:07.426271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74503ba-8964-41fd-baef-fb8bd0e3c9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:07.426547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74503ba-8964-41fd-baef-fb8bd0e3c9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:07.436701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74503ba-8964-41fd-baef-fb8bd0e3c9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:07.438119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74503ba-8964-41fd-baef-fb8bd0e3c9dc service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:07.448002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 970/1990] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:07.483020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:07.596465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:07.610181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:07.612970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:07.705052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a2e8a-cdca-4444-bc74-90e6bbe78358 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:07.710968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:07.712087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:07.712361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:07.712783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] PATH_INFO: `/v3/users/e0cf8cd026a648ca88a5fb5692e9e950` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:07.715907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0cf8cd026a648ca88a5fb5692e9e950)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:07.721058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:07.930571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0cf8cd026a648ca88a5fb5692e9e950'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:07.937728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0cf8cd026a648ca88a5fb5692e9e950'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:07.938446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0cf8cd026a648ca88a5fb5692e9e950'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:07.939092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0cf8cd026a648ca88a5fb5692e9e950'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:07.951951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0cf8cd026a648ca88a5fb5692e9e950'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:08.088292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1021/1991] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:07 2022] DELETE /identity/v3/users/e0cf8cd026a648ca88a5fb5692e9e950 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:08.093344 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:08.093799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:08.093885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:08.113849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:08.115461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:08.197173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 971/1992] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:08.208676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:08.210222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:08.273070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:08.278208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe27c15-3a30-4052-973b-44ad30ef9216 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:08.283383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:08.288229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:08.288229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:08.288229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:08.295199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:08.296694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:08.310523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1022/1993] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:08.405011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:08.894652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:08.896144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:08.913360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6811716-b102-4a85-bf6b-38c964189227 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:08.921198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:08.922095 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:08.922379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:08.922656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] PATH_INFO: `/v3/projects/d69b74903a414388aec418dcd3798278` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:08.924135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69b74903a414388aec418dcd3798278)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:08.926333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:09.087039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69b74903a414388aec418dcd3798278', 'request_id': 'req-84344a3a-6c17-4449-a119-668635bebde2'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.093965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69b74903a414388aec418dcd3798278', 'request_id': 'req-84344a3a-6c17-4449-a119-668635bebde2'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.104810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:09.106704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69b74903a414388aec418dcd3798278', 'request_id': 'req-84344a3a-6c17-4449-a119-668635bebde2'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.107567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:09.125160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138eb78-ac77-4af3-a81e-79a2f2cd551b service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:09.194504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] The token cache is being invalidate because project d69b74903a414388aec418dcd3798278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:09.195414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.196977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.199674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 972/1994] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:08 2022] DELETE /identity/v3/projects/d69b74903a414388aec418dcd3798278 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:09.204073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:09.207874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:09.208617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:09.209896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:09.210412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:09.210759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] PATH_INFO: `/v3/users/09ed90ff24df46e69977f46181bc20e5` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:09.212744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ed90ff24df46e69977f46181bc20e5)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:09.215943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:09.238690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84344a3a-6c17-4449-a119-668635bebde2 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:09.247784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:09.249019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:09.249513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:09.250848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] PATH_INFO: `/v3/users/cc3de8288c674248becc96d0c53654ef` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:09.252510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3de8288c674248becc96d0c53654ef)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:09.254515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:09.403194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:09.452146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ed90ff24df46e69977f46181bc20e5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.460288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ed90ff24df46e69977f46181bc20e5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.461310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ed90ff24df46e69977f46181bc20e5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.462012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ed90ff24df46e69977f46181bc20e5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.466267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3de8288c674248becc96d0c53654ef'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.476377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ed90ff24df46e69977f46181bc20e5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.562190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3de8288c674248becc96d0c53654ef'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.569972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3de8288c674248becc96d0c53654ef'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.571160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3de8288c674248becc96d0c53654ef'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.571389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e0b25f-c979-40c0-ad6a-d054b1c69ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3de8288c674248becc96d0c53654ef'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.594507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 973/1995] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:09 2022] DELETE /identity/v3/users/cc3de8288c674248becc96d0c53654ef => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:09.631296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1023/1996] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:09 2022] DELETE /identity/v3/users/09ed90ff24df46e69977f46181bc20e5 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:09.632521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:09.632824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:09.633102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:09.664149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:09.666338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:09.671981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:09.774473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 974/1997] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:09.785928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:09.787639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:09.880660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5e300-422a-451c-bdd8-3dec81e5cc56 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:09.885163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:09.885821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:09.886108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:09.886384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:09.897311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:09.899964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:09.920282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1024/1998] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:10.121893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:10.123897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:10.136393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076d2c-914b-4a6e-b7d6-c56dd1b8fdc6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:10.141948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:10.142846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:10.143132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:10.143627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] PATH_INFO: `/v3/projects/8dcfd94986794659873657adc1508e3b` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:10.145145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcfd94986794659873657adc1508e3b)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:10.148686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:10.258171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:10.271346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcfd94986794659873657adc1508e3b', 'request_id': 'req-229b61f8-4724-4e11-a0bd-b52b1756dcde'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.278081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcfd94986794659873657adc1508e3b', 'request_id': 'req-229b61f8-4724-4e11-a0bd-b52b1756dcde'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.288268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcfd94986794659873657adc1508e3b', 'request_id': 'req-229b61f8-4724-4e11-a0bd-b52b1756dcde'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.407696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] The token cache is being invalidate because project 8dcfd94986794659873657adc1508e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:10.408002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.408947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.409725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:10.410564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 975/1999] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:10 2022] DELETE /identity/v3/projects/8dcfd94986794659873657adc1508e3b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:10.414332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:10.414482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:10.415708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:10.433225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e6cf7-bb0e-4c8d-aede-06f9b6690906 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:10.449363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:10.503368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:10.504337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:10.504666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:10.504946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] PATH_INFO: `/v3/projects/2962e9b1bd6a43fa81974551c22d4043` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:10.510059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b61f8-4724-4e11-a0bd-b52b1756dcde admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:10.512373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2962e9b1bd6a43fa81974551c22d4043)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:10.514055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:10.517680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:10.518610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:10.519082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:10.519501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] PATH_INFO: `/v3/users/b103f79be4c040c18985cdaa1118162e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:10.521525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b103f79be4c040c18985cdaa1118162e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:10.523823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:10.626636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2962e9b1bd6a43fa81974551c22d4043', 'request_id': 'req-0ff26e12-075b-4e47-953a-1caf760613bf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.632686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2962e9b1bd6a43fa81974551c22d4043', 'request_id': 'req-0ff26e12-075b-4e47-953a-1caf760613bf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.638145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2962e9b1bd6a43fa81974551c22d4043', 'request_id': 'req-0ff26e12-075b-4e47-953a-1caf760613bf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.745194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] The token cache is being invalidate because project 2962e9b1bd6a43fa81974551c22d4043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:10.745491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.746147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.747741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1025/2000] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:10 2022] DELETE /identity/v3/projects/2962e9b1bd6a43fa81974551c22d4043 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:10.751948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:10.753285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:10.779833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b103f79be4c040c18985cdaa1118162e'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.819191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff26e12-075b-4e47-953a-1caf760613bf admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:10.824081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:10.824958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:10.825245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:10.825525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] PATH_INFO: `/v3/users/c65baf3c7c99459096393688c6674654` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:10.826740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65baf3c7c99459096393688c6674654)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:10.828704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:10.865950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:10.911236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b103f79be4c040c18985cdaa1118162e'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.923835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b103f79be4c040c18985cdaa1118162e'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.925032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b103f79be4c040c18985cdaa1118162e'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.926326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b103f79be4c040c18985cdaa1118162e'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.949699 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 976/2001] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:10 2022] DELETE /identity/v3/users/b103f79be4c040c18985cdaa1118162e => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:11.148225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65baf3c7c99459096393688c6674654'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.155647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65baf3c7c99459096393688c6674654'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.156320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65baf3c7c99459096393688c6674654'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.156937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65baf3c7c99459096393688c6674654'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.169203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65baf3c7c99459096393688c6674654'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.251307 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1026/2002] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:10 2022] DELETE /identity/v3/users/c65baf3c7c99459096393688c6674654 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:11.420868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.424522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.504538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993108f2-7763-47ff-a323-bfac241f1d8c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.528297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:11.567943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.568811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.569091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.569457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] PATH_INFO: `/v3/projects/9469c72d3293410f99b3b600e70fd49a` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.571004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9469c72d3293410f99b3b600e70fd49a)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.572974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.678815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9469c72d3293410f99b3b600e70fd49a', 'request_id': 'req-733e8693-a7b5-495c-9cd5-4f9faf901e06'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.686389 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9469c72d3293410f99b3b600e70fd49a', 'request_id': 'req-733e8693-a7b5-495c-9cd5-4f9faf901e06'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.692285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9469c72d3293410f99b3b600e70fd49a', 'request_id': 'req-733e8693-a7b5-495c-9cd5-4f9faf901e06'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.747510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.749166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.763095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0b0f4-bc50-41d6-9176-a348e1f746de admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.781092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] The token cache is being invalidate because project 9469c72d3293410f99b3b600e70fd49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:11.781574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.782259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733e8693-a7b5-495c-9cd5-4f9faf901e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.784021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 977/2003] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:11 2022] DELETE /identity/v3/projects/9469c72d3293410f99b3b600e70fd49a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:11.788665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f12266-88f8-410e-90cc-839c117711ac None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.788962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f12266-88f8-410e-90cc-839c117711ac None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.789270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f12266-88f8-410e-90cc-839c117711ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.809068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-00f12266-88f8-410e-90cc-839c117711ac None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:11.811668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-00f12266-88f8-410e-90cc-839c117711ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.839345 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.840314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.840668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.841085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] PATH_INFO: `/v3/projects/e622084a5732482785186bd890ff4cc3` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.842486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e622084a5732482785186bd890ff4cc3)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.844617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.872521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 978/2004] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:11.881253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08539-4861-4e94-8e1f-6fe22292f6e7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.881544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08539-4861-4e94-8e1f-6fe22292f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.881822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df08539-4861-4e94-8e1f-6fe22292f6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.899754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9df08539-4861-4e94-8e1f-6fe22292f6e7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:11.901027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9df08539-4861-4e94-8e1f-6fe22292f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.909830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 979/2005] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:11.913789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df08539-4861-4e94-8e1f-6fe22292f6e7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.923604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df08539-4861-4e94-8e1f-6fe22292f6e7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.928579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.929380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.929615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.929923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.930647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:11.930988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.932605 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.945086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 980/2006] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:11.949115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.950599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e622084a5732482785186bd890ff4cc3', 'request_id': 'req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.957195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e622084a5732482785186bd890ff4cc3', 'request_id': 'req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.957906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:11.961627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e82c7f-a64b-499c-a61d-f78568323978 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.963840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e622084a5732482785186bd890ff4cc3', 'request_id': 'req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.021015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.021718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.022013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.022296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.023027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.025172 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.041908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] The token cache is being invalidate because project e622084a5732482785186bd890ff4cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:12.042161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.043656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c9bd63b3-c21d-49b2-9ae4-cddfbf6306f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.049493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1027/2007] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:11 2022] DELETE /identity/v3/projects/e622084a5732482785186bd890ff4cc3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:12.050911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7634-7596-462d-b5c6-4a81ad438ee0 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.051354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7634-7596-462d-b5c6-4a81ad438ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.051677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7634-7596-462d-b5c6-4a81ad438ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.071338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-42ef7634-7596-462d-b5c6-4a81ad438ee0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:12.072822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-42ef7634-7596-462d-b5c6-4a81ad438ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.083159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1028/2008] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:12.088976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ed38-3fb4-48fb-b67e-b354de467008 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.089269 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ed38-3fb4-48fb-b67e-b354de467008 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.089551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ed38-3fb4-48fb-b67e-b354de467008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.111446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9350ed38-3fb4-48fb-b67e-b354de467008 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:12.112774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9350ed38-3fb4-48fb-b67e-b354de467008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.120847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1029/2009] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:12.125551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ed38-3fb4-48fb-b67e-b354de467008 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.136308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ed38-3fb4-48fb-b67e-b354de467008 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.141145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.141821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.142110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.142441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.143206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:12.143544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.145246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.161221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 981/2010] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:11 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:12.162228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1030/2011] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:12.162423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.163540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.165320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.169153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:12.180632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bab2-df98-449b-ac17-cc5f32b5235d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.246111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ca5ca-9739-4fab-9c5c-c693c4d967a2 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.249961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.250637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.250853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.250967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.251230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.251485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.251773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.251943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.252047 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.252885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.253890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.255246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.367617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1031/2012] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:12.372293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.382669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241c233-1c35-4d4f-9b1f-927e0a648a9e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.388150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.390498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.390498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.390498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.390498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.392123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.397225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 982/2013] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:12.397974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.404389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1032/2014] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:12.408389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.420441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a548c-46a3-4849-a4c0-1f66f83601f6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.467892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e84ca-6f03-4a27-bbb8-84a1889fe5e0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.478937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.478937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.478937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.478937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.479495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.479495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.484967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.485696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.485991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.486574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.487037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.488633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.499864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1033/2015] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:12.503958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.517090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a777-21cc-440a-b8b1-10601d60db37 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.522162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e611c-6e2c-406c-93ef-f84b72d77e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.523080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e611c-6e2c-406c-93ef-f84b72d77e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.523370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e611c-6e2c-406c-93ef-f84b72d77e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.523973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e611c-6e2c-406c-93ef-f84b72d77e00 admin admin] PATH_INFO: `/v3/projects/05bd1375c6784f58a77c9b508ff282c9/users/4468a51c478d4fd38f2bc3066dff63ff/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.539517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e611c-6e2c-406c-93ef-f84b72d77e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bd1375c6784f58a77c9b508ff282c9, user_id=4468a51c478d4fd38f2bc3066dff63ff, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.542195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e611c-6e2c-406c-93ef-f84b72d77e00 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.564298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:12.570582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 983/2016] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:12.575019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.584966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88c8b2-0232-4a99-893a-d4e81646d319 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.590561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.591261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.591544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.591822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.592555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.594148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.597855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1034/2017] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:12 2022] PUT /identity/v3/projects/05bd1375c6784f58a77c9b508ff282c9/users/4468a51c478d4fd38f2bc3066dff63ff/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:12.603366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.603662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.603945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.605435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 984/2018] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:12.608978 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.619577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc345cd-31ef-458b-a1b8-4d8620044507 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.624113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:12.625354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.682071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.682849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.683135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.683685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.684712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.686404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.690256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1035/2019] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:12.697321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.699594 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.701806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 985/2020] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:12.706255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.722971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddde9f-9e9b-4b18-9903-e10f86b4542e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.728841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.729769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.730052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.730324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] PATH_INFO: `/v3/projects/c14ffa860c254abc9a4af7c9acc40eed/users/c3023f7d3a6e471f943b79b57e01ff21/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.748183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14ffa860c254abc9a4af7c9acc40eed, user_id=c3023f7d3a6e471f943b79b57e01ff21, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.751844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.775573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092a72-cf29-4b77-afa9-19ddb78eab97 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.780242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad12f4b-e363-4294-82ce-d6c164500999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.780947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12f4b-e363-4294-82ce-d6c164500999 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.781237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12f4b-e363-4294-82ce-d6c164500999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.781838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad12f4b-e363-4294-82ce-d6c164500999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.792020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad12f4b-e363-4294-82ce-d6c164500999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.795673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad12f4b-e363-4294-82ce-d6c164500999 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.804317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1036/2021] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:12.824733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 986/2022] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:12 2022] PUT /identity/v3/projects/c14ffa860c254abc9a4af7c9acc40eed/users/c3023f7d3a6e471f943b79b57e01ff21/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:12.830421 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328a9ea-122b-4027-bcfb-3b2eebf18820 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.830709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328a9ea-122b-4027-bcfb-3b2eebf18820 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.831036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328a9ea-122b-4027-bcfb-3b2eebf18820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.861411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6328a9ea-122b-4027-bcfb-3b2eebf18820 None None] MFA Rules not processed for user `c3023f7d3a6e471f943b79b57e01ff21`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:12.862733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6328a9ea-122b-4027-bcfb-3b2eebf18820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.924112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:12.928207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1037/2023] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:12.932643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.980432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:12.996701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42fb8-f0fc-4c20-8f18-b57f53ac0792 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.001688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366825c-2cce-4735-8ccf-881be13bbc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.002539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366825c-2cce-4735-8ccf-881be13bbc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.002839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366825c-2cce-4735-8ccf-881be13bbc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.003133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366825c-2cce-4735-8ccf-881be13bbc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.003824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366825c-2cce-4735-8ccf-881be13bbc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.005764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366825c-2cce-4735-8ccf-881be13bbc02 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.095175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 987/2024] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:13.099625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328a9ea-122b-4027-bcfb-3b2eebf18820 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.112101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328a9ea-122b-4027-bcfb-3b2eebf18820 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.177810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.178543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.178852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.180132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.180132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.182095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.206067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31ca0-4395-4a13-af99-773ee057eb84 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.206446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31ca0-4395-4a13-af99-773ee057eb84 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.206812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31ca0-4395-4a13-af99-773ee057eb84 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.208425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 988/2025] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:08:13.222265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f120bb-8804-4c14-97ac-1f16dd5d4e82 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.222686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f120bb-8804-4c14-97ac-1f16dd5d4e82 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.223097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f120bb-8804-4c14-97ac-1f16dd5d4e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.241697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-30f120bb-8804-4c14-97ac-1f16dd5d4e82 None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:13.242979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-30f120bb-8804-4c14-97ac-1f16dd5d4e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:13.274851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1038/2026] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:13 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:13.277210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.297559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899bbe3-9ba1-483b-b2f1-fea4eefdead4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.307267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.309606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.309897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.310177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.310993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.312569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 989/2027] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:08:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:13.313502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.327070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1039/2028] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:13.330904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f120bb-8804-4c14-97ac-1f16dd5d4e82 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.335704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.337576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:13.343476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f120bb-8804-4c14-97ac-1f16dd5d4e82 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.366210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.367012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.367295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.367568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] PATH_INFO: `/v3/projects/9c75bc03fb7744ecbea2b5b7f159152d/users/6fa87df86c144aae87112b8e203d05e2/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.374169 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925eeab-1444-411a-8c2e-86391340b04f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.383327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.384337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.384692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.385079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.390584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c75bc03fb7744ecbea2b5b7f159152d, user_id=6fa87df86c144aae87112b8e203d05e2, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.394006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.396986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.399393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.412182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1040/2029] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:13.461150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 990/2030] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:13 2022] PUT /identity/v3/projects/9c75bc03fb7744ecbea2b5b7f159152d/users/6fa87df86c144aae87112b8e203d05e2/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:13.465358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.478635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f04cd-c674-4a39-8563-bd9d65aee278 service placement] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.542008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:13.555188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e161d64-2e92-46ef-98e0-8c4a5655bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.555865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161d64-2e92-46ef-98e0-8c4a5655bd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.556153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161d64-2e92-46ef-98e0-8c4a5655bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.556432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161d64-2e92-46ef-98e0-8c4a5655bd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.557209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e161d64-2e92-46ef-98e0-8c4a5655bd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.559523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e161d64-2e92-46ef-98e0-8c4a5655bd32 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.571907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1041/2031] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:13.576353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.586749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc51c2-32ab-41fe-bded-0aaeafa09347 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.591425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:13.593373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.594288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.594576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.594907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] PATH_INFO: `/v3/projects/9c75bc03fb7744ecbea2b5b7f159152d/users/6fa87df86c144aae87112b8e203d05e2/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.596906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c75bc03fb7744ecbea2b5b7f159152d, user_id=6fa87df86c144aae87112b8e203d05e2, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.599643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.610575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 991/2032] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:13 2022] PUT /identity/v3/projects/9c75bc03fb7744ecbea2b5b7f159152d/users/6fa87df86c144aae87112b8e203d05e2/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:13.622231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1558c6-b049-4d81-8a7f-c354c148da3b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.622520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1558c6-b049-4d81-8a7f-c354c148da3b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.622804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1558c6-b049-4d81-8a7f-c354c148da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.649038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-cf1558c6-b049-4d81-8a7f-c354c148da3b None None] MFA Rules not processed for user `6fa87df86c144aae87112b8e203d05e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:13.650246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cf1558c6-b049-4d81-8a7f-c354c148da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:13.734338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1042/2033] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:13.752205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.754155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:13.829555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edef58c-474f-4281-9a81-254d3877b45e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.833731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff5ba8-cb51-4698-9cdc-7f0f3f871b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.834399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5ba8-cb51-4698-9cdc-7f0f3f871b90 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.834690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5ba8-cb51-4698-9cdc-7f0f3f871b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.835007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff5ba8-cb51-4698-9cdc-7f0f3f871b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.845518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff5ba8-cb51-4698-9cdc-7f0f3f871b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.846999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff5ba8-cb51-4698-9cdc-7f0f3f871b90 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.857724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 992/2034] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:14.055515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293379e9-ca31-4b1f-af30-64d6a877f8f1 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.055904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293379e9-ca31-4b1f-af30-64d6a877f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.056246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293379e9-ca31-4b1f-af30-64d6a877f8f1 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.057790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1043/2035] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:08:14.070302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa60ce-db19-46ff-a3dd-5a929dc74a41 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.070690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa60ce-db19-46ff-a3dd-5a929dc74a41 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.071075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa60ce-db19-46ff-a3dd-5a929dc74a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.088805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:14.097125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3dfa60ce-db19-46ff-a3dd-5a929dc74a41 None None] MFA Rules not processed for user `dd20d4b992c84434ba0ab81046009e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:14.098942 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3dfa60ce-db19-46ff-a3dd-5a929dc74a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:14.223671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293379e9-ca31-4b1f-af30-64d6a877f8f1 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:14.224658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 993/2036] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:08:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:14.226514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-293379e9-ca31-4b1f-af30-64d6a877f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:14.239993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa60ce-db19-46ff-a3dd-5a929dc74a41 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:14.254541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa60ce-db19-46ff-a3dd-5a929dc74a41 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:14.261921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb000b9-68fd-4012-86b9-553bd0671766 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:14.262508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb000b9-68fd-4012-86b9-553bd0671766 service placement] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.263531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb000b9-68fd-4012-86b9-553bd0671766 service placement] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.264414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb000b9-68fd-4012-86b9-553bd0671766 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.275710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb000b9-68fd-4012-86b9-553bd0671766 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:14.278083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb000b9-68fd-4012-86b9-553bd0671766 service placement] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:14.290467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 994/2037] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:14.318643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293379e9-ca31-4b1f-af30-64d6a877f8f1 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:14.324391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:14.325336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.325684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.326050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] PATH_INFO: `/v3/users/78b7a8d913d9417d820a9c429b1f1f4d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.327419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b7a8d913d9417d820a9c429b1f1f4d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:14.329356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:14.479984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5f5fd-ce61-4da1-8004-1834ba33006f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.480504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5f5fd-ce61-4da1-8004-1834ba33006f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.481039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5f5fd-ce61-4da1-8004-1834ba33006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.511882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-54a5f5fd-ce61-4da1-8004-1834ba33006f None None] MFA Rules not processed for user `4468a51c478d4fd38f2bc3066dff63ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:14.513806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-54a5f5fd-ce61-4da1-8004-1834ba33006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:14.586589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 995/2038] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:14.587492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5f5fd-ce61-4da1-8004-1834ba33006f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:14.598272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5f5fd-ce61-4da1-8004-1834ba33006f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:14.603436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:14.604340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.604628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.604907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] PATH_INFO: `/v3/users/c3023f7d3a6e471f943b79b57e01ff21` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.606235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3023f7d3a6e471f943b79b57e01ff21)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:14.608266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:14.614413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b7a8d913d9417d820a9c429b1f1f4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.623162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b7a8d913d9417d820a9c429b1f1f4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.623986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b7a8d913d9417d820a9c429b1f1f4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.624658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b7a8d913d9417d820a9c429b1f1f4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.638582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b7a8d913d9417d820a9c429b1f1f4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.745263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:14.751268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1044/2039] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:14 2022] DELETE /identity/v3/users/78b7a8d913d9417d820a9c429b1f1f4d => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:14.754320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:14.754320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:14.812578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0876-e0e9-4b64-9f77-4b30d159576d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:14.816814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f840-4940-4ded-bdb7-484f9d81d1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:14.817461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f840-4940-4ded-bdb7-484f9d81d1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.817804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f840-4940-4ded-bdb7-484f9d81d1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.818069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f840-4940-4ded-bdb7-484f9d81d1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.819982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a623f840-4940-4ded-bdb7-484f9d81d1c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:14.825849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3023f7d3a6e471f943b79b57e01ff21'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.880868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623f840-4940-4ded-bdb7-484f9d81d1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:14.882329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623f840-4940-4ded-bdb7-484f9d81d1c1 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:14.891424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1045/2040] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:14.900379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3023f7d3a6e471f943b79b57e01ff21'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.908403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3023f7d3a6e471f943b79b57e01ff21'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.909286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3023f7d3a6e471f943b79b57e01ff21'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.909941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3023f7d3a6e471f943b79b57e01ff21'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:14.932369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 996/2041] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:14 2022] DELETE /identity/v3/users/c3023f7d3a6e471f943b79b57e01ff21 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:14.937466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:14.937705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:14.937989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:14.955070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:14.956259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:14.975593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:14.978651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:15.063729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1046/2042] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:15.074026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80696e-620f-462a-8869-700fd07a9ac1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:15.076423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:15.077836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:15.080397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:15.081416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:15.081800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:15.082177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] PATH_INFO: `/v3/projects/6fa2a998362c44238ce3527a52e8269a` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:15.083496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa2a998362c44238ce3527a52e8269a)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:15.085506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:15.138599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc90e40-507e-4a54-aade-cf9da67100a1 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:15.144100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:15.144843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:15.145136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:15.145413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:15.155182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:15.156608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:15.166817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1047/2043] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:15.225509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:15.248562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa2a998362c44238ce3527a52e8269a', 'request_id': 'req-2eef41f6-2155-4242-a591-6275fbf4d9b1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.254949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa2a998362c44238ce3527a52e8269a', 'request_id': 'req-2eef41f6-2155-4242-a591-6275fbf4d9b1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.261005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa2a998362c44238ce3527a52e8269a', 'request_id': 'req-2eef41f6-2155-4242-a591-6275fbf4d9b1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.276420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:15.357291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] The token cache is being invalidate because project 6fa2a998362c44238ce3527a52e8269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:15.357581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.358362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.359975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 997/2044] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:14 2022] DELETE /identity/v3/projects/6fa2a998362c44238ce3527a52e8269a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:15.364236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:15.374131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba8f1-a2f6-47a9-8429-b8d442f7a2e4 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:15.436499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:15.437658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:15.438009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:15.438351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] PATH_INFO: `/v3/users/2f157c6cbd0548a899d2d10fa44a4263` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:15.439707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f157c6cbd0548a899d2d10fa44a4263)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:15.441628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:15.620710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:15.622149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:15.638479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef41f6-2155-4242-a591-6275fbf4d9b1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:15.643707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:15.644583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:15.644921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:15.645206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] PATH_INFO: `/v3/projects/c14ffa860c254abc9a4af7c9acc40eed` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:15.646534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14ffa860c254abc9a4af7c9acc40eed)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:15.649446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:15.664009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f157c6cbd0548a899d2d10fa44a4263'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.669132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f157c6cbd0548a899d2d10fa44a4263'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.669922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f157c6cbd0548a899d2d10fa44a4263'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.670759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f157c6cbd0548a899d2d10fa44a4263'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.686855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f157c6cbd0548a899d2d10fa44a4263'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.775086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14ffa860c254abc9a4af7c9acc40eed', 'request_id': 'req-77a4c109-6e7b-4c45-bc09-51c42c3bea27'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.782187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14ffa860c254abc9a4af7c9acc40eed', 'request_id': 'req-77a4c109-6e7b-4c45-bc09-51c42c3bea27'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.784977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1048/2045] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:15 2022] DELETE /identity/v3/users/2f157c6cbd0548a899d2d10fa44a4263 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:15.788621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14ffa860c254abc9a4af7c9acc40eed', 'request_id': 'req-77a4c109-6e7b-4c45-bc09-51c42c3bea27'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.888748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] The token cache is being invalidate because project c14ffa860c254abc9a4af7c9acc40eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:15.889049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.889703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:15.891390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 998/2046] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:15 2022] DELETE /identity/v3/projects/c14ffa860c254abc9a4af7c9acc40eed => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:15.895416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:15.897114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:15.972451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b8f0f-385d-44aa-80c1-c19a3bc82d53 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:15.977653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:15.978537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:15.978840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:15.979121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] PATH_INFO: `/v3/users/6fa87df86c144aae87112b8e203d05e2` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:15.980427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa87df86c144aae87112b8e203d05e2)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:15.985855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:16.079222 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:16.080745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:16.145265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4c109-6e7b-4c45-bc09-51c42c3bea27 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:16.150159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:16.151045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.151331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.151609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] PATH_INFO: `/v3/projects/7132ca9d80ca4059a44580211a2e18f7` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.152815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7132ca9d80ca4059a44580211a2e18f7)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:16.154712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:16.176918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa87df86c144aae87112b8e203d05e2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.185263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa87df86c144aae87112b8e203d05e2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.186087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa87df86c144aae87112b8e203d05e2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.186803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa87df86c144aae87112b8e203d05e2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.202109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a0ddaca4-0194-4d64-9538-2912c1a1cba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa87df86c144aae87112b8e203d05e2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.278765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1049/2047] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:15 2022] DELETE /identity/v3/users/6fa87df86c144aae87112b8e203d05e2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:16.313801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7132ca9d80ca4059a44580211a2e18f7', 'request_id': 'req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.321192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7132ca9d80ca4059a44580211a2e18f7', 'request_id': 'req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.327449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7132ca9d80ca4059a44580211a2e18f7', 'request_id': 'req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.396639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:16.447322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] The token cache is being invalidate because project 7132ca9d80ca4059a44580211a2e18f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:16.447635 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.448232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a6a7f033-cb24-48b4-ac94-cb3eb2a81886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.449796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 999/2048] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:16 2022] DELETE /identity/v3/projects/7132ca9d80ca4059a44580211a2e18f7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:16.454650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c941-8d50-4460-9139-c906116d49b0 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.454975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c941-8d50-4460-9139-c906116d49b0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.455257 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7c941-8d50-4460-9139-c906116d49b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.473845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a1e7c941-8d50-4460-9139-c906116d49b0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:16.475895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a1e7c941-8d50-4460-9139-c906116d49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:16.545167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1050/2049] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:16.553157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683516d-9b57-414e-9c29-58385173f618 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.553449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683516d-9b57-414e-9c29-58385173f618 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.553955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683516d-9b57-414e-9c29-58385173f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.576619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c683516d-9b57-414e-9c29-58385173f618 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:16.578045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c683516d-9b57-414e-9c29-58385173f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:16.586451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1000/2050] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:16.591870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7c941-8d50-4460-9139-c906116d49b0 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:16.602886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7c941-8d50-4460-9139-c906116d49b0 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:16.608116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44491f79-da38-43f4-aa88-bf1231b404f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:16.608853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44491f79-da38-43f4-aa88-bf1231b404f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.609139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44491f79-da38-43f4-aa88-bf1231b404f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.609416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44491f79-da38-43f4-aa88-bf1231b404f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.610246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44491f79-da38-43f4-aa88-bf1231b404f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:16.610665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44491f79-da38-43f4-aa88-bf1231b404f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:16.612526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44491f79-da38-43f4-aa88-bf1231b404f6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:16.630072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1051/2051] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:16.631257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683516d-9b57-414e-9c29-58385173f618 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:16.643625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683516d-9b57-414e-9c29-58385173f618 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:16.650259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:16.651008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.651199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.651297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.651495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.651649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.652275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.652504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:16.654553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:16.670119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] MFA Rules not processed for user `4468a51c478d4fd38f2bc3066dff63ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:16.671467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:16.727718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1052/2052] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:16.750209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:16.751656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:16.771059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432afcd-6ca6-4c97-b62f-ad68e3b17a7d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:16.775266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1001/2053] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:16 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:16.780452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:16.780614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:16.781341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.781758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.782039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] PATH_INFO: `/v3/projects/9c75bc03fb7744ecbea2b5b7f159152d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.783274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c75bc03fb7744ecbea2b5b7f159152d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:16.785393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:16.825226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:16.881649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d6fd-3b09-4d3a-ac47-c5f7a12d67d6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:16.886395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:16.888758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:16.889109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:16.889459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:16.890303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:16.892891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:16.911185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c75bc03fb7744ecbea2b5b7f159152d', 'request_id': 'req-d754961b-87d3-42f4-a71f-ea78133f0eb4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.919430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c75bc03fb7744ecbea2b5b7f159152d', 'request_id': 'req-d754961b-87d3-42f4-a71f-ea78133f0eb4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.925819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c75bc03fb7744ecbea2b5b7f159152d', 'request_id': 'req-d754961b-87d3-42f4-a71f-ea78133f0eb4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:16.989784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1002/2054] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:16 2022] POST /identity/v3/users => generated 280 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:16.990757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.001649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729d1ff-8292-470f-992d-ddbdeffa6594 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.021641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] The token cache is being invalidate because project 9c75bc03fb7744ecbea2b5b7f159152d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:17.022078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:17.022860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d754961b-87d3-42f4-a71f-ea78133f0eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:17.024941 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1053/2055] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:16 2022] DELETE /identity/v3/projects/9c75bc03fb7744ecbea2b5b7f159152d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:17.030469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea878e-8bf8-46a9-8629-5c294c63a5fb None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.030912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea878e-8bf8-46a9-8629-5c294c63a5fb None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.031350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea878e-8bf8-46a9-8629-5c294c63a5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.057781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a0ea878e-8bf8-46a9-8629-5c294c63a5fb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:17.059929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a0ea878e-8bf8-46a9-8629-5c294c63a5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:17.083874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.085144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.085653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.086048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.086883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.088732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.104184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1003/2056] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:17.105805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.107712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:17.120828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ba90b-213d-4c4b-a9a0-55a1cc1100d6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.126215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.127056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.127345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.127621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.128370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.129991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.134255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1054/2057] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:17.142329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdae5-412d-4d4f-ae01-e35540f893e6 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.142931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdae5-412d-4d4f-ae01-e35540f893e6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.143367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbdae5-412d-4d4f-ae01-e35540f893e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.149106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1004/2058] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:17.150176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.161032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21479f5b-0f0f-4cae-af29-2b8939fc9fd0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.166652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-71bbdae5-412d-4d4f-ae01-e35540f893e6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:17.166793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373177e1-e9e8-42ca-99b3-8c54d2f7ce52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.170238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373177e1-e9e8-42ca-99b3-8c54d2f7ce52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.170347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-71bbdae5-412d-4d4f-ae01-e35540f893e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:17.170438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373177e1-e9e8-42ca-99b3-8c54d2f7ce52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.170438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373177e1-e9e8-42ca-99b3-8c54d2f7ce52 admin admin] PATH_INFO: `/v3/projects/e393ef7159774072a7648359f6ad3db4/users/f593bf2b57e445aea07233f41a60c4fb/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.176890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1055/2059] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:17.181188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdae5-412d-4d4f-ae01-e35540f893e6 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.184707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373177e1-e9e8-42ca-99b3-8c54d2f7ce52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e393ef7159774072a7648359f6ad3db4, user_id=f593bf2b57e445aea07233f41a60c4fb, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.187444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373177e1-e9e8-42ca-99b3-8c54d2f7ce52 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.190973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbdae5-412d-4d4f-ae01-e35540f893e6 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.196244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.197029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.197657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.197942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.199508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:17.199648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.201181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.213484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1056/2060] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:17.218360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.228414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54ae1-306a-4804-a223-c6f8bf4f07ea admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.233599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.233888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.234176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.234458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.235492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.237661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.253891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1005/2061] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:17 2022] PUT /identity/v3/projects/e393ef7159774072a7648359f6ad3db4/users/f593bf2b57e445aea07233f41a60c4fb/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:17.271113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.271472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.271833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.298806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] MFA Rules not processed for user `f593bf2b57e445aea07233f41a60c4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:17.300071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:17.315876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1057/2062] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:17 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:17.316144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.388326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1006/2063] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:17.430532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643abeb-56b0-4cfc-8951-d0e4c6948178 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.430637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.430637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:17.432239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.433532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.433895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.434243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.435356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.437356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.488230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301a7c4-8dbb-439c-b346-c563688705b7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.528077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1058/2064] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:17 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:17.532317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.537265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.538160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.538498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.538908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.547664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039aff5-4f3b-4b81-9184-9100e1b7cca5 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.564244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.564930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.566342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.566342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.567003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.568780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.580961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1059/2065] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:17.586659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.597872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:17.600899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3de9-8a5b-4a78-b727-2f1e43d35410 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.606377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.607100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.608822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.608822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.608822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.610189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.611879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.613698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.625965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1060/2066] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:17.628293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1007/2067] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:17 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:17.629829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.644427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f843f80-eea7-4eca-ac98-07907fd90f12 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.645152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.652210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d56e7-6fa1-4cda-a1bb-c9402b3d61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.653595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d56e7-6fa1-4cda-a1bb-c9402b3d61ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.654017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d56e7-6fa1-4cda-a1bb-c9402b3d61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.654601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d56e7-6fa1-4cda-a1bb-c9402b3d61ac admin admin] PATH_INFO: `/v3/projects/2825c0be61f641e1b242f8f9457154c2/users/2f65f5617c8e40fcb0f90d0c3b7699a7/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.657785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156c849-7ec6-4af0-b660-52c52ac6dff9 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.665810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.666866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.671645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.671645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] PATH_INFO: `/v3/users/f593bf2b57e445aea07233f41a60c4fb` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.671645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f593bf2b57e445aea07233f41a60c4fb)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.671645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.674008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d56e7-6fa1-4cda-a1bb-c9402b3d61ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2825c0be61f641e1b242f8f9457154c2, user_id=2f65f5617c8e40fcb0f90d0c3b7699a7, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.676722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d56e7-6fa1-4cda-a1bb-c9402b3d61ac admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.746038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1061/2068] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:17 2022] PUT /identity/v3/projects/2825c0be61f641e1b242f8f9457154c2/users/2f65f5617c8e40fcb0f90d0c3b7699a7/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:17.757266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.757565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.757851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.768459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:17.786798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] MFA Rules not processed for user `2f65f5617c8e40fcb0f90d0c3b7699a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:17.788049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:17.850159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1062/2069] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:17.862466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:17.863835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:17.920063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7483b1-47a4-4661-a109-3f2adeebee18 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:17.923629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601bfbb-eba8-444c-baa9-2a5cebeb6ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:17.924279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601bfbb-eba8-444c-baa9-2a5cebeb6ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:17.924556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601bfbb-eba8-444c-baa9-2a5cebeb6ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:17.924829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601bfbb-eba8-444c-baa9-2a5cebeb6ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:17.933899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601bfbb-eba8-444c-baa9-2a5cebeb6ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:17.935364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601bfbb-eba8-444c-baa9-2a5cebeb6ff9 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:17.949428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1063/2070] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:17.968587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f593bf2b57e445aea07233f41a60c4fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.039737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f593bf2b57e445aea07233f41a60c4fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.048168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f593bf2b57e445aea07233f41a60c4fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.048913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f593bf2b57e445aea07233f41a60c4fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.049515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f593bf2b57e445aea07233f41a60c4fb'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.068076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1008/2071] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:17 2022] DELETE /identity/v3/users/f593bf2b57e445aea07233f41a60c4fb => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:18.072578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:18.072948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:18.073338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:18.093728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:18.095397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:18.168059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1064/2072] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:18.177978 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:18.179392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:18.255152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c72462-9a6d-49fb-88e2-3d899746ccc3 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:18.259574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb87dcb-acff-4c17-9efe-361ce111dbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:18.260227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87dcb-acff-4c17-9efe-361ce111dbcd service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:18.260507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87dcb-acff-4c17-9efe-361ce111dbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:18.260781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87dcb-acff-4c17-9efe-361ce111dbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:18.270290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb87dcb-acff-4c17-9efe-361ce111dbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:18.271755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb87dcb-acff-4c17-9efe-361ce111dbcd service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:18.281424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1009/2073] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:18.345678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:18.425419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:18.671232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:18.734003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:18.742146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:18.752247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4137a37-a3bb-4736-ae45-c6290ceccf0f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:18.757023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:18.760281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:18.761926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:18.762321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:18.762927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] PATH_INFO: `/v3/projects/e393ef7159774072a7648359f6ad3db4` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:18.767289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e393ef7159774072a7648359f6ad3db4)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:18.767289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:18.882144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e393ef7159774072a7648359f6ad3db4', 'request_id': 'req-6e7c3330-871a-475c-92b9-012d76d9ca4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.888797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e393ef7159774072a7648359f6ad3db4', 'request_id': 'req-6e7c3330-871a-475c-92b9-012d76d9ca4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.894316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e393ef7159774072a7648359f6ad3db4', 'request_id': 'req-6e7c3330-871a-475c-92b9-012d76d9ca4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.966808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] The token cache is being invalidate because project e393ef7159774072a7648359f6ad3db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:18.967125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.967755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6e7c3330-871a-475c-92b9-012d76d9ca4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:18.969282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1065/2074] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:18 2022] DELETE /identity/v3/projects/e393ef7159774072a7648359f6ad3db4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:18.974430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46474c49-e76e-4a58-9d72-db3f6fb32e14 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:18.974720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46474c49-e76e-4a58-9d72-db3f6fb32e14 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:18.975033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46474c49-e76e-4a58-9d72-db3f6fb32e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:18.992940 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-46474c49-e76e-4a58-9d72-db3f6fb32e14 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:18.994072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-46474c49-e76e-4a58-9d72-db3f6fb32e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:19.052570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1010/2075] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:19.060789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98278b4-1fb7-4a0e-b9d3-e6ea4a867cd4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.061106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98278b4-1fb7-4a0e-b9d3-e6ea4a867cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.061390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98278b4-1fb7-4a0e-b9d3-e6ea4a867cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.080277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e98278b4-1fb7-4a0e-b9d3-e6ea4a867cd4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:19.081554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e98278b4-1fb7-4a0e-b9d3-e6ea4a867cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:19.089650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1066/2076] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:19.093864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46474c49-e76e-4a58-9d72-db3f6fb32e14 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.103968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46474c49-e76e-4a58-9d72-db3f6fb32e14 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.108691 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.109417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.109704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.110038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.110983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:19.111312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.113865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.117132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:19.125357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1011/2077] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:19.129589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98278b4-1fb7-4a0e-b9d3-e6ea4a867cd4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.139607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98278b4-1fb7-4a0e-b9d3-e6ea4a867cd4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.144450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.145383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.149749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.149749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.149749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.149749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.167855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:19.264081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1067/2078] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:19 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:19.265092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.276075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf96e8c-4f67-4ede-b4fc-a58ee1876569 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.337660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.338424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.338784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.339224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.339909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.341823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.460237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1012/2079] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:19 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:19.464570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.474852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab27f5-c105-4fc3-bff9-bc6e8b3729eb admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.480412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.480835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.481119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.481505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.482239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.483849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.488842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:19.494471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1068/2080] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:19.499060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.520606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31715-c4ae-40dd-aaaa-b45ccc315827 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.529970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f63ec5-c710-413c-a46d-6f222cf6b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.530649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f63ec5-c710-413c-a46d-6f222cf6b21f admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.530972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f63ec5-c710-413c-a46d-6f222cf6b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.531319 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f63ec5-c710-413c-a46d-6f222cf6b21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.532049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f63ec5-c710-413c-a46d-6f222cf6b21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.533645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f63ec5-c710-413c-a46d-6f222cf6b21f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.545228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1013/2081] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:19.549823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.551688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:19.562168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948911-0b96-4fd9-b66d-5690bdf21694 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.566682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.569572 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.569857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.570196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] PATH_INFO: `/v3/projects/21f65a72a8b9487fa7ac5932bec4e96f/users/24e219d9aa3a486ca0e2e198e7926fb2/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.587884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f65a72a8b9487fa7ac5932bec4e96f, user_id=24e219d9aa3a486ca0e2e198e7926fb2, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.590863 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.671806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1069/2082] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:19 2022] PUT /identity/v3/projects/21f65a72a8b9487fa7ac5932bec4e96f/users/24e219d9aa3a486ca0e2e198e7926fb2/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:19.682549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4f6f-e635-46a9-8061-93b5bbcc83a7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.683451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4f6f-e635-46a9-8061-93b5bbcc83a7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.683900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4f6f-e635-46a9-8061-93b5bbcc83a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.726007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-5c5b4f6f-e635-46a9-8061-93b5bbcc83a7 None None] MFA Rules not processed for user `24e219d9aa3a486ca0e2e198e7926fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:19.728751 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5c5b4f6f-e635-46a9-8061-93b5bbcc83a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:19.734438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:19.803613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1014/2083] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:19.808102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.860077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:19.913566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b880181-467f-4910-9b42-f0085d31f684 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.920524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.921188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.921475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.921752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.922450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.924423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.060574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1070/2084] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:19 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:20.061296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b4f6f-e635-46a9-8061-93b5bbcc83a7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.074065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b4f6f-e635-46a9-8061-93b5bbcc83a7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.138877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.139493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.139788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.140038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.140764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.144620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.266092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1015/2085] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:20 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:20.269983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.290981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508594-736e-4592-8e40-4561e46e6e77 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.299879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.299984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.300754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.300754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.301696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.303756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.330867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1071/2086] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:20.333464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.344632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a1254-f432-4de7-a991-a41515b1ef2d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.362017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.363447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.363447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.363714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] PATH_INFO: `/v3/projects/5d11123be03d481e8dd913b14a0043e5/users/c93fcde288a74a1c838eb9b01195978a/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.380009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d11123be03d481e8dd913b14a0043e5, user_id=c93fcde288a74a1c838eb9b01195978a, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.382695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.464206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1016/2087] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:20 2022] PUT /identity/v3/projects/5d11123be03d481e8dd913b14a0043e5/users/c93fcde288a74a1c838eb9b01195978a/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:20.465319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.475522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d2f3-326e-4ab8-bad9-4bda4495f297 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.537430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f510e-984d-4cd8-81de-a9c40173b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.538092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f510e-984d-4cd8-81de-a9c40173b6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.538379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f510e-984d-4cd8-81de-a9c40173b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.538661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f510e-984d-4cd8-81de-a9c40173b6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.539472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f510e-984d-4cd8-81de-a9c40173b6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.541033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f510e-984d-4cd8-81de-a9c40173b6d4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.551827 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1072/2088] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:20.556067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.567858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08715e7-ad78-41f7-af5a-7803d11d54af admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.572882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.574259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.574548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.574850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] PATH_INFO: `/v3/projects/5d11123be03d481e8dd913b14a0043e5/users/c93fcde288a74a1c838eb9b01195978a/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.576899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d11123be03d481e8dd913b14a0043e5, user_id=c93fcde288a74a1c838eb9b01195978a, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.579612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.600312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1017/2089] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:20 2022] PUT /identity/v3/projects/5d11123be03d481e8dd913b14a0043e5/users/c93fcde288a74a1c838eb9b01195978a/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:20.603207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.603507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.603789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.632167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] MFA Rules not processed for user `c93fcde288a74a1c838eb9b01195978a`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:20.633774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:20.704913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1073/2090] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:20.715975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.717704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:20.777588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61df6b-3bad-4c00-a02c-0fc9b6dcf3a6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.782397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b538f-412a-4c32-8b49-21fa3d82d02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.783107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b538f-412a-4c32-8b49-21fa3d82d02e service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.783588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b538f-412a-4c32-8b49-21fa3d82d02e service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.783876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b538f-412a-4c32-8b49-21fa3d82d02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.843885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b538f-412a-4c32-8b49-21fa3d82d02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.845224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b538f-412a-4c32-8b49-21fa3d82d02e service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.854494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1018/2091] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:20.918659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:21.070867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:21.458146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.459576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:21.528899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7c79-5f3b-4b7f-928f-1f850a0fb56b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.533615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.534503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.534788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.535103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] PATH_INFO: `/v3/users/c90a25a42ca94df1939e7a902d00ef56` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.536318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90a25a42ca94df1939e7a902d00ef56)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:21.538451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:21.596666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:21.788573 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90a25a42ca94df1939e7a902d00ef56'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.795412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90a25a42ca94df1939e7a902d00ef56'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.796159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90a25a42ca94df1939e7a902d00ef56'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.796771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90a25a42ca94df1939e7a902d00ef56'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.802645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:21.809485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90a25a42ca94df1939e7a902d00ef56'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.882089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1074/2092] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:21 2022] DELETE /identity/v3/users/c90a25a42ca94df1939e7a902d00ef56 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:21.887221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.887714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.887807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.905907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:21.907155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:21.964276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1019/2093] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:21.973885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.975319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:22.032948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e50c9-160a-42cc-ad89-be86db08ee6b admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.036792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc2c3c-8395-4e7a-ad1a-1137e914e23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.037529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2c3c-8395-4e7a-ad1a-1137e914e23f service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.037819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2c3c-8395-4e7a-ad1a-1137e914e23f service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.038102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2c3c-8395-4e7a-ad1a-1137e914e23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.047659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc2c3c-8395-4e7a-ad1a-1137e914e23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.049088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc2c3c-8395-4e7a-ad1a-1137e914e23f service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.059231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1075/2094] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:22.122558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.179727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.363230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.390751 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.530276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.531901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:22.554292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79255-7032-4f52-8680-ba7490747a3a None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.554292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.554292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.554292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.555200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] PATH_INFO: `/v3/projects/0d91fe94fc6d4d42a2718d3c89d7d39c` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.555200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d91fe94fc6d4d42a2718d3c89d7d39c)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.556233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.602436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.687991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d91fe94fc6d4d42a2718d3c89d7d39c', 'request_id': 'req-80e4128a-0348-4c98-a6d2-e164cd75e527'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:22.694039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d91fe94fc6d4d42a2718d3c89d7d39c', 'request_id': 'req-80e4128a-0348-4c98-a6d2-e164cd75e527'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:22.699988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d91fe94fc6d4d42a2718d3c89d7d39c', 'request_id': 'req-80e4128a-0348-4c98-a6d2-e164cd75e527'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:22.721795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.783377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] The token cache is being invalidate because project 0d91fe94fc6d4d42a2718d3c89d7d39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:22.783667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:22.784296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-80e4128a-0348-4c98-a6d2-e164cd75e527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:22.785871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1020/2095] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:22 2022] DELETE /identity/v3/projects/0d91fe94fc6d4d42a2718d3c89d7d39c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:22.792286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d200cfd-3e2c-43cb-bca0-89c1fa9a4437 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.792724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d200cfd-3e2c-43cb-bca0-89c1fa9a4437 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.793107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d200cfd-3e2c-43cb-bca0-89c1fa9a4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.817784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4d200cfd-3e2c-43cb-bca0-89c1fa9a4437 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:22.817784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4d200cfd-3e2c-43cb-bca0-89c1fa9a4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:22.876457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1076/2096] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:22.885175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110cbe6-e08c-4787-98d3-3c020d7a88d4 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.885466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110cbe6-e08c-4787-98d3-3c020d7a88d4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.885767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110cbe6-e08c-4787-98d3-3c020d7a88d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.890023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.906237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b110cbe6-e08c-4787-98d3-3c020d7a88d4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:22.907515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b110cbe6-e08c-4787-98d3-3c020d7a88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:22.915565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1021/2097] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:22.919797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d200cfd-3e2c-43cb-bca0-89c1fa9a4437 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.930282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d200cfd-3e2c-43cb-bca0-89c1fa9a4437 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.935436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.936087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.936371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.936649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.937400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:22.937707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.939342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.954868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1077/2098] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:22.956294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110cbe6-e08c-4787-98d3-3c020d7a88d4 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.965462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110cbe6-e08c-4787-98d3-3c020d7a88d4 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.970145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.970799 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.971115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.971395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.972102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.974049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.089344 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1022/2099] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:22 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:23.093368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.104336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfd1bc-7a39-46e6-b3ba-f0ca04876a03 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.139785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:23.162993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.163667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.163955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.164236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.164964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.166969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.294712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1078/2100] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:23 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:23.298892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.310538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55190c7-4917-408e-b6d1-b09ab54ba15b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.315102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.315786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.316066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.316345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.317072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.318656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.329148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1023/2101] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:23.333086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.343135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576612a-eb66-4eb6-8785-09f98aff3049 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.347708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb0e7-78d4-4036-81bc-c3a762ba74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.348360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb0e7-78d4-4036-81bc-c3a762ba74c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.348647 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb0e7-78d4-4036-81bc-c3a762ba74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.348928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb0e7-78d4-4036-81bc-c3a762ba74c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.349678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb0e7-78d4-4036-81bc-c3a762ba74c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.351286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb0e7-78d4-4036-81bc-c3a762ba74c9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.362298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1079/2102] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:23.366479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.377167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab699ae-319b-4bd5-8896-ba320043d348 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.381712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.382587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.382928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.383239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] PATH_INFO: `/v3/projects/5e0b6a0eecd3446a8b4cf8661137d43d/users/c624446f4c8546d397502d7e4a41f09c/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.399313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0b6a0eecd3446a8b4cf8661137d43d, user_id=c624446f4c8546d397502d7e4a41f09c, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.402579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.481824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1024/2103] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:23 2022] PUT /identity/v3/projects/5e0b6a0eecd3446a8b4cf8661137d43d/users/c624446f4c8546d397502d7e4a41f09c/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:23.492454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.492454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.492454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.523785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] MFA Rules not processed for user `c624446f4c8546d397502d7e4a41f09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:23.525127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:23.618959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1080/2104] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:23.634928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.637315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:23.707738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5a0d-922c-455d-9f55-3ca49049402d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.711506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2ef23-f323-4477-a02c-e311e13246ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.712174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2ef23-f323-4477-a02c-e311e13246ee service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.712444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2ef23-f323-4477-a02c-e311e13246ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.712724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2ef23-f323-4477-a02c-e311e13246ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.722075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2ef23-f323-4477-a02c-e311e13246ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.723537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2ef23-f323-4477-a02c-e311e13246ee service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.733069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1025/2105] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:26.077204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:26.079286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:26.146562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84573b-3360-4883-93e6-595740ee1733 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:26.151128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:26.152592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:26.152876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:26.153153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] PATH_INFO: `/v3/users/24e219d9aa3a486ca0e2e198e7926fb2` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:26.154507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e219d9aa3a486ca0e2e198e7926fb2)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:26.156394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:26.330174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e219d9aa3a486ca0e2e198e7926fb2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:26.331394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:26.337534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e219d9aa3a486ca0e2e198e7926fb2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:26.338234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e219d9aa3a486ca0e2e198e7926fb2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:26.339463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e219d9aa3a486ca0e2e198e7926fb2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:26.351504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e219d9aa3a486ca0e2e198e7926fb2'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:26.412774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1081/2106] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:26 2022] DELETE /identity/v3/users/24e219d9aa3a486ca0e2e198e7926fb2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:26.417340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:26.417853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:26.417989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:26.435582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:26.446909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:26.446909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:26.503611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1026/2107] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:26.514080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:26.516164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:26.574099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b10a-ff92-482a-9277-91127fb48106 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:26.577855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:26.578501 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:26.578780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:26.579140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:26.588530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:26.589915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:26.599716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1082/2108] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:27.083493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:27.085925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:27.112699 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9536-e241-4e26-a1bd-3d8b01b4eb35 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:27.117440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:27.120655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:27.120655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:27.120655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] PATH_INFO: `/v3/projects/21f65a72a8b9487fa7ac5932bec4e96f` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:27.120655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f65a72a8b9487fa7ac5932bec4e96f)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:27.122057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:27.230351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f65a72a8b9487fa7ac5932bec4e96f', 'request_id': 'req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.236467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f65a72a8b9487fa7ac5932bec4e96f', 'request_id': 'req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.241867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f65a72a8b9487fa7ac5932bec4e96f', 'request_id': 'req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.315035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] The token cache is being invalidate because project 21f65a72a8b9487fa7ac5932bec4e96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:27.315324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.315943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.317470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1027/2109] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:27 2022] DELETE /identity/v3/projects/21f65a72a8b9487fa7ac5932bec4e96f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:27.321388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:27.331845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ba67-96c3-45a4-a56f-b6532caee015 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:27.396758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:27.397630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:27.397910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:27.398185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] PATH_INFO: `/v3/users/c93fcde288a74a1c838eb9b01195978a` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:27.399499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93fcde288a74a1c838eb9b01195978a)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:27.401742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:27.575938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93fcde288a74a1c838eb9b01195978a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.582788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93fcde288a74a1c838eb9b01195978a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.583766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93fcde288a74a1c838eb9b01195978a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.584400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93fcde288a74a1c838eb9b01195978a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.594929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:27.597152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8e7e4d97-4541-4a1b-aae4-a4ee3faefc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93fcde288a74a1c838eb9b01195978a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.692388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1083/2110] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:27 2022] DELETE /identity/v3/users/c93fcde288a74a1c838eb9b01195978a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:28.094334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.095803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:28.108998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f6c1b-9a99-43ed-990a-55b9d4c05d14 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.168581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.169443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.169722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.169995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] PATH_INFO: `/v3/projects/5d11123be03d481e8dd913b14a0043e5` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.171226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d11123be03d481e8dd913b14a0043e5)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.173125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.268192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:28.276929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d11123be03d481e8dd913b14a0043e5', 'request_id': 'req-39325fba-1d5f-4439-9377-eaba2e6987a1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.283646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d11123be03d481e8dd913b14a0043e5', 'request_id': 'req-39325fba-1d5f-4439-9377-eaba2e6987a1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.289068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d11123be03d481e8dd913b14a0043e5', 'request_id': 'req-39325fba-1d5f-4439-9377-eaba2e6987a1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.371457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] The token cache is being invalidate because project 5d11123be03d481e8dd913b14a0043e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:28.371835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.372610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-39325fba-1d5f-4439-9377-eaba2e6987a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.374263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1028/2111] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:28 2022] DELETE /identity/v3/projects/5d11123be03d481e8dd913b14a0043e5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:28.379433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f212a-7af4-4788-976f-2addb8e02a94 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.379868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f212a-7af4-4788-976f-2addb8e02a94 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.379868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f212a-7af4-4788-976f-2addb8e02a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.400154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e05f212a-7af4-4788-976f-2addb8e02a94 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:28.401556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e05f212a-7af4-4788-976f-2addb8e02a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:28.464017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1084/2112] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:28.472098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492f62-1cb7-41df-8798-9e85b5d3a8b1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.472391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492f62-1cb7-41df-8798-9e85b5d3a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.472673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492f62-1cb7-41df-8798-9e85b5d3a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.491409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-61492f62-1cb7-41df-8798-9e85b5d3a8b1 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:28.492615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-61492f62-1cb7-41df-8798-9e85b5d3a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:28.501752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1029/2113] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:28.505977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f212a-7af4-4788-976f-2addb8e02a94 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.515887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f212a-7af4-4788-976f-2addb8e02a94 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.521205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.521878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.522166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.522449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.523255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:28.523568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.525172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.537079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1085/2114] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:28.541607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492f62-1cb7-41df-8798-9e85b5d3a8b1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.551730 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492f62-1cb7-41df-8798-9e85b5d3a8b1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.556667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.557979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.558268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.558546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.559610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.561547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.672463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1030/2115] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:28 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:28.676634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.687253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3a7a6-00a4-49ea-9a37-93ae7bcd0130 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.745003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.745666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.745945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.746219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.746925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.749370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.847986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1086/2116] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:28 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:28.856830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.867330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb79d-e0b0-481f-8bcd-da8dad097594 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.872090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.872791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.875754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.875754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.875754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.875754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.887332 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1031/2117] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:28.891080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.902140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea70b1e-05f1-4e5e-bbdb-e3e1c508129d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.906978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401c33c-1c02-4669-b0c2-db427f35166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.907642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401c33c-1c02-4669-b0c2-db427f35166d admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.907933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401c33c-1c02-4669-b0c2-db427f35166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.908231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401c33c-1c02-4669-b0c2-db427f35166d admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.908960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401c33c-1c02-4669-b0c2-db427f35166d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.910584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401c33c-1c02-4669-b0c2-db427f35166d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.921735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1087/2118] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:28.925915 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.938278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb022-20fe-4b65-9905-9f2a7aaeb7e5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.943664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.944555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.944839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.945117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] PATH_INFO: `/v3/projects/fb66780102db4890bf5881f717ffc5ea/users/3367b67a8bcf4ff0995f2864be8eccb6/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.960585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb66780102db4890bf5881f717ffc5ea, user_id=3367b67a8bcf4ff0995f2864be8eccb6, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.963302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.035871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1032/2119] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:28 2022] PUT /identity/v3/projects/fb66780102db4890bf5881f717ffc5ea/users/3367b67a8bcf4ff0995f2864be8eccb6/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:29.046702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b376-0468-468f-aa69-3369d12ef336 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.047020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b376-0468-468f-aa69-3369d12ef336 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.047297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5b376-0468-468f-aa69-3369d12ef336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.074589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-21f5b376-0468-468f-aa69-3369d12ef336 None None] MFA Rules not processed for user `3367b67a8bcf4ff0995f2864be8eccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:29.076137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-21f5b376-0468-468f-aa69-3369d12ef336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.124235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:29.147468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1088/2120] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:29.152483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.226975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ef2c-87b1-40d8-a858-14d457728fde admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.231283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.231955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.232239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.232524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.233217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.235211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.312197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1033/2121] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:29.316210 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5b376-0468-468f-aa69-3369d12ef336 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.327315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5b376-0468-468f-aa69-3369d12ef336 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.385137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.386402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.386685 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.386997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.387683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.389727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.492898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1089/2122] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:29.496939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.516733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd38f7-1fef-4b36-a6cf-ed9d6e5d29f0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.521538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.522330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.526901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.526901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.526901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.526901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.537104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1034/2123] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:29.541090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.551676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812c211-279a-4e02-af24-684849a87fa6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.556506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fac43-dd9e-4d66-9dca-531fd2010134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.557160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fac43-dd9e-4d66-9dca-531fd2010134 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.557981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fac43-dd9e-4d66-9dca-531fd2010134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.558255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fac43-dd9e-4d66-9dca-531fd2010134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.559015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fac43-dd9e-4d66-9dca-531fd2010134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.560891 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fac43-dd9e-4d66-9dca-531fd2010134 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.571380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1090/2124] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:29.576194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.587112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d85ef2-982f-413f-9e65-30b32170d271 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.592475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.593234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.593578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.593962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] PATH_INFO: `/v3/projects/da9a5633d7a24bf3bdbbed8a866b99de/users/0c52b0ab0da94082b7543f9f00027abf/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.609155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9a5633d7a24bf3bdbbed8a866b99de, user_id=0c52b0ab0da94082b7543f9f00027abf, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.612325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.682025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1035/2125] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:29 2022] PUT /identity/v3/projects/da9a5633d7a24bf3bdbbed8a866b99de/users/0c52b0ab0da94082b7543f9f00027abf/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:29.693808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.694102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.694386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.722131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] MFA Rules not processed for user `0c52b0ab0da94082b7543f9f00027abf`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:29.723381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.794948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1091/2126] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:29.799244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.813616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:29.856620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.858532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.869669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab5ffd-5798-4d8d-bac5-b745bd4b8ce0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.873554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f9d2-02eb-482f-9e5b-7dbaad5538d6 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.875394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.876233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.879803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.879803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.879803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.880051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.880051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.880229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.880305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.880305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] PATH_INFO: `/v3/users/c624446f4c8546d397502d7e4a41f09c` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.881470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c624446f4c8546d397502d7e4a41f09c)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.883503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.964025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1036/2127] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:29.967789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.036182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2513cd-d847-4de4-8721-574b1ae3a16e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.049853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.050766 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.051620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.051732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.052363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.054665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.070166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:30.072007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c624446f4c8546d397502d7e4a41f09c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.085007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c624446f4c8546d397502d7e4a41f09c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.085786 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c624446f4c8546d397502d7e4a41f09c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.086665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c624446f4c8546d397502d7e4a41f09c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.101868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4e8d5fa3-13f1-484a-a73b-ec1d87b15b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c624446f4c8546d397502d7e4a41f09c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.163197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1037/2128] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:30.167791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.169449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.183761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd521-f868-4e9d-b946-65d18229d105 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.186432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1092/2129] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:29 2022] DELETE /identity/v3/users/c624446f4c8546d397502d7e4a41f09c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:30.190571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.191004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.191361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.210365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:30.211719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.263616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.264312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.264593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.264874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.266284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.268068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.279713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1038/2130] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:30.283706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.294983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e4282-cfaa-4dd4-b16e-f8e6da0b3d89 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.298138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1093/2131] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:30.299850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.304397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.304397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.304397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] PATH_INFO: `/v3/projects/5fab0361b30c40bfab8e2ca5d4291222/users/04c7d9ba063e4933bdf55a6e9fddbb3b/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.305865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.308095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.319773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fab0361b30c40bfab8e2ca5d4291222, user_id=04c7d9ba063e4933bdf55a6e9fddbb3b, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.322638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.373814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568bac4-e51a-49a1-9b62-58a0a37a3b25 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.378196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.379056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.380079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.380414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.391616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.393226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.403157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1094/2132] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:30.408354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:30.414849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1039/2133] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:30 2022] PUT /identity/v3/projects/5fab0361b30c40bfab8e2ca5d4291222/users/04c7d9ba063e4933bdf55a6e9fddbb3b/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:30.419127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.431875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dfee9-0619-42c2-89c2-c96949f2d9ce service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.512682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cb282-bab6-4094-ad93-35bd3fe91761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.513408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cb282-bab6-4094-ad93-35bd3fe91761 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.513697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cb282-bab6-4094-ad93-35bd3fe91761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.513998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cb282-bab6-4094-ad93-35bd3fe91761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.514737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cb282-bab6-4094-ad93-35bd3fe91761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.516559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cb282-bab6-4094-ad93-35bd3fe91761 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.531416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1095/2134] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:30.535693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.550793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a643a-6fb2-4942-ab34-de3ba2fe4141 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.556310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.558251 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.558532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.558974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] PATH_INFO: `/v3/projects/5fab0361b30c40bfab8e2ca5d4291222/users/04c7d9ba063e4933bdf55a6e9fddbb3b/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.562449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fab0361b30c40bfab8e2ca5d4291222, user_id=04c7d9ba063e4933bdf55a6e9fddbb3b, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.565114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.578649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1040/2135] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:30 2022] PUT /identity/v3/projects/5fab0361b30c40bfab8e2ca5d4291222/users/04c7d9ba063e4933bdf55a6e9fddbb3b/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:30.588802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.589103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.589390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.595623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:30.619732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] MFA Rules not processed for user `04c7d9ba063e4933bdf55a6e9fddbb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:30.621502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.704738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1096/2136] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:30.717603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.718318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.780748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5620f-2283-4904-a00f-3ce749557e25 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.784795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.785494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.785782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.786063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.788003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.850025 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.851384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.861394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1041/2137] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:31.034949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.036373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:31.153219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7665d-d6a2-4409-976c-802b38fda0dd None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.158173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.159087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.159378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.159659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] PATH_INFO: `/v3/projects/5e0b6a0eecd3446a8b4cf8661137d43d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.160937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0b6a0eecd3446a8b4cf8661137d43d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.162919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.420986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0b6a0eecd3446a8b4cf8661137d43d', 'request_id': 'req-263b7684-3215-4c4c-8980-facd8cfa9e5d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:31.428083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0b6a0eecd3446a8b4cf8661137d43d', 'request_id': 'req-263b7684-3215-4c4c-8980-facd8cfa9e5d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:31.433840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0b6a0eecd3446a8b4cf8661137d43d', 'request_id': 'req-263b7684-3215-4c4c-8980-facd8cfa9e5d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:31.630230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] The token cache is being invalidate because project 5e0b6a0eecd3446a8b4cf8661137d43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:31.630526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:31.631215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:31.655610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1097/2138] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:31 2022] DELETE /identity/v3/projects/5e0b6a0eecd3446a8b4cf8661137d43d => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:33.288577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:33.307108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab5830-a520-4687-95b9-d7d07771b0d0 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:33.375583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:33.376248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:33.376532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:33.376848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:33.378851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:33.442065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:33.445948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:33.447433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:33.463855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1042/2139] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:34.617498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:34.617498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:34.634757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:34.680679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b7684-3215-4c4c-8980-facd8cfa9e5d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:34.686437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:34.687346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:34.687698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:34.687954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] PATH_INFO: `/v3/users/0a8cc558dee74179b538f20c1b90f44c` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:34.689125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8cc558dee74179b538f20c1b90f44c)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:34.691186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:34.838035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8cc558dee74179b538f20c1b90f44c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.844637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8cc558dee74179b538f20c1b90f44c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.845302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8cc558dee74179b538f20c1b90f44c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.845918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8cc558dee74179b538f20c1b90f44c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.858072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6c986f5e-a17f-46fa-b65a-ec03f547d500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8cc558dee74179b538f20c1b90f44c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.909112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1098/2140] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:34 2022] DELETE /identity/v3/users/0a8cc558dee74179b538f20c1b90f44c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:35.170960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.184074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f110fd6-4eba-4bff-b07e-bbcf3c5171df service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.248722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.249601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.249882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.250157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] PATH_INFO: `/v3/projects/e06efd9f018749e3931f713b485d6f84` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.251393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06efd9f018749e3931f713b485d6f84)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.253269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.371631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06efd9f018749e3931f713b485d6f84', 'request_id': 'req-376c1ce2-c861-47c3-a763-761c4618faab'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.377765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06efd9f018749e3931f713b485d6f84', 'request_id': 'req-376c1ce2-c861-47c3-a763-761c4618faab'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.383584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06efd9f018749e3931f713b485d6f84', 'request_id': 'req-376c1ce2-c861-47c3-a763-761c4618faab'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.463132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] The token cache is being invalidate because project e06efd9f018749e3931f713b485d6f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:35.463534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.464152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-376c1ce2-c861-47c3-a763-761c4618faab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.465734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1043/2141] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:35 2022] DELETE /identity/v3/projects/e06efd9f018749e3931f713b485d6f84 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:35.479648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6368d-e107-45ef-8e2f-654d6108ab85 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.480044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6368d-e107-45ef-8e2f-654d6108ab85 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.480316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6368d-e107-45ef-8e2f-654d6108ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.498542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-1ea6368d-e107-45ef-8e2f-654d6108ab85 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:35.499772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1ea6368d-e107-45ef-8e2f-654d6108ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:35.560304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1099/2142] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:35.568522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449f555-f893-42c6-97c4-a7ede0c4bebc None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.568826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449f555-f893-42c6-97c4-a7ede0c4bebc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.569107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449f555-f893-42c6-97c4-a7ede0c4bebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.588453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c449f555-f893-42c6-97c4-a7ede0c4bebc None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:35.589789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c449f555-f893-42c6-97c4-a7ede0c4bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:35.597949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1044/2143] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:35.602601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6368d-e107-45ef-8e2f-654d6108ab85 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.612456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6368d-e107-45ef-8e2f-654d6108ab85 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.617002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.617926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.618471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.618471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.619316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:35.619632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.621732 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.634987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1100/2144] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:35.639856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449f555-f893-42c6-97c4-a7ede0c4bebc None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.649118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449f555-f893-42c6-97c4-a7ede0c4bebc None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.653778 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.654430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.654716 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.655020 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.655711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.657640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.739481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1045/2145] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:35.743552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.753935 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59c065-6a46-4e00-9910-da2b00c622d5 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.774222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:35.810671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.811432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.811715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.811993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.812680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.814579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.887091 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1101/2146] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:35.891116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.901576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd77ad-850c-40cb-b75e-6a8da16633f6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.906233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.906911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.907195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.907470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.908293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.909871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.920448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1046/2147] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:35.924224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.934586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfdd03-d14b-4b51-9679-4f7ce8c1f57b admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.939257 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e599f9-c9f4-4390-bf89-5d06fe731971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.939897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e599f9-c9f4-4390-bf89-5d06fe731971 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.940179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e599f9-c9f4-4390-bf89-5d06fe731971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.940456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e599f9-c9f4-4390-bf89-5d06fe731971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.941171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e599f9-c9f4-4390-bf89-5d06fe731971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.942920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e599f9-c9f4-4390-bf89-5d06fe731971 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.952726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1102/2148] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:35.956879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.966501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00bad-8fcf-4462-99c8-9a3f1e255bb4 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.971143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.972015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.972295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.972571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] PATH_INFO: `/v3/projects/27cd77392b924e64ba52350c775cf638/users/8e3e567058964720964d98e76e55e462/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.987682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cd77392b924e64ba52350c775cf638, user_id=8e3e567058964720964d98e76e55e462, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.990307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:36.058960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1047/2149] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:35 2022] PUT /identity/v3/projects/27cd77392b924e64ba52350c775cf638/users/8e3e567058964720964d98e76e55e462/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:36.067055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:36.067055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:36.067055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:36.082791 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:36.084037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:36.144453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1103/2150] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:36.154745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:36.156474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:36.179735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:36.215612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fdcb4-a9d8-41ab-8318-b0d83b82ee37 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:36.219339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b3e50-105e-4765-96d9-10c7488a09ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:36.221560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b3e50-105e-4765-96d9-10c7488a09ab service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:36.221560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b3e50-105e-4765-96d9-10c7488a09ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:36.221560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b3e50-105e-4765-96d9-10c7488a09ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:36.230991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b3e50-105e-4765-96d9-10c7488a09ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:36.232401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b3e50-105e-4765-96d9-10c7488a09ab service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:36.247027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1048/2151] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:36.728529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:36.730098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:36.791646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640daae-c239-476e-970b-80cf6713fbbe None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:36.796050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:36.799587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:36.799587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:36.799587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:36.799587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:36.881333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:36.885475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:36.887823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:36.898115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1104/2152] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:41.909661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:41.910202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:41.910202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:41.945297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] MFA Rules not processed for user `8e3e567058964720964d98e76e55e462`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:41.946893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:42.047755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1049/2153] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:42.053500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:42.055044 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:42.135142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023c3ac-915d-4422-85fb-87ad848e15f0 service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:42.141493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a4fe2-96c1-4822-8ee8-70a9c180f76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:42.142095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a4fe2-96c1-4822-8ee8-70a9c180f76d service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:42.148621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a4fe2-96c1-4822-8ee8-70a9c180f76d service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:42.148621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a4fe2-96c1-4822-8ee8-70a9c180f76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:42.152674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a4fe2-96c1-4822-8ee8-70a9c180f76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:42.154318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a4fe2-96c1-4822-8ee8-70a9c180f76d service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:42.168514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1105/2154] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:43.356179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:43.357765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:43.372388 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2aae8-61ff-49e4-b03f-9eb41b614666 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:43.376957 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:43.378144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:43.378328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:43.378603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] PATH_INFO: `/v3/users/3367b67a8bcf4ff0995f2864be8eccb6` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:43.380219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3367b67a8bcf4ff0995f2864be8eccb6)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:43.382261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:43.593090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3367b67a8bcf4ff0995f2864be8eccb6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:43.687470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3367b67a8bcf4ff0995f2864be8eccb6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:43.697802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3367b67a8bcf4ff0995f2864be8eccb6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:43.699255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3367b67a8bcf4ff0995f2864be8eccb6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:43.702559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3367b67a8bcf4ff0995f2864be8eccb6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:43.731387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1050/2155] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:43 2022] DELETE /identity/v3/users/3367b67a8bcf4ff0995f2864be8eccb6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:43.733626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:43.734108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:43.734367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:43.768024 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:43.769687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:43.895385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1106/2156] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:43.906560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:43.908174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:43.952469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:44.001188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70637743-bc4b-4118-91f2-9b4bd19bee25 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:44.005601 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc6374-3a37-4958-9a17-0a14c7f0c3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:44.006771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc6374-3a37-4958-9a17-0a14c7f0c3cf service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:44.007093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc6374-3a37-4958-9a17-0a14c7f0c3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:44.007442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc6374-3a37-4958-9a17-0a14c7f0c3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:44.044912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc6374-3a37-4958-9a17-0a14c7f0c3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:44.046535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc6374-3a37-4958-9a17-0a14c7f0c3cf service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:44.060311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1051/2157] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:44.621103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:44.627045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:44.648675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882e295-fa7c-4a12-ad22-e0a05fdb8824 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:44.661875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:44.662898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:44.663254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:44.663613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] PATH_INFO: `/v3/projects/fb66780102db4890bf5881f717ffc5ea` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:44.665781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb66780102db4890bf5881f717ffc5ea)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:44.669100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:44.836700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb66780102db4890bf5881f717ffc5ea', 'request_id': 'req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:44.848129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb66780102db4890bf5881f717ffc5ea', 'request_id': 'req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:44.867561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb66780102db4890bf5881f717ffc5ea', 'request_id': 'req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:44.961657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] The token cache is being invalidate because project fb66780102db4890bf5881f717ffc5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:44.964631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:44.964631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:44.965849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1107/2158] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:44 2022] DELETE /identity/v3/projects/fb66780102db4890bf5881f717ffc5ea => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:44.969458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:44.970641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:44.971111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:44.971191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:44.971263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:44.976773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:44.989131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] MFA Rules not processed for user `8e3e567058964720964d98e76e55e462`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:44.990486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:45.065003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8228a-7d9b-49d2-8e8a-d386efbdcbb1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:45.075935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1052/2159] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:45.076130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:45.076130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:45.076130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:45.076130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] PATH_INFO: `/v3/users/0c52b0ab0da94082b7543f9f00027abf` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:45.077098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c52b0ab0da94082b7543f9f00027abf)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:45.079227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:45.266715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c52b0ab0da94082b7543f9f00027abf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.280238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c52b0ab0da94082b7543f9f00027abf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.281069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c52b0ab0da94082b7543f9f00027abf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.282395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c52b0ab0da94082b7543f9f00027abf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.320942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dbb10c09-fe99-418e-a919-e6cb0f91f88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c52b0ab0da94082b7543f9f00027abf'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.371311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:45.372726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:45.399133 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560c9b5-430b-40ec-ad65-8e329e1428e8 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:45.404512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:45.405476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:45.405830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:45.406221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] PATH_INFO: `/v3/users/2f65f5617c8e40fcb0f90d0c3b7699a7` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:45.407646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f65f5617c8e40fcb0f90d0c3b7699a7)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:45.409633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:45.427085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1108/2160] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:44 2022] DELETE /identity/v3/users/0c52b0ab0da94082b7543f9f00027abf => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:45.706565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f65f5617c8e40fcb0f90d0c3b7699a7'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.795137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f65f5617c8e40fcb0f90d0c3b7699a7'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.815182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f65f5617c8e40fcb0f90d0c3b7699a7'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.816134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f65f5617c8e40fcb0f90d0c3b7699a7'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.818991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f65f5617c8e40fcb0f90d0c3b7699a7'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:45.867219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1053/2161] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:45 2022] DELETE /identity/v3/users/2f65f5617c8e40fcb0f90d0c3b7699a7 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:45.871530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:45.872039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:45.872943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:45.897513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:45.899245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:45.982547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1109/2162] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:45.992617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:45.996030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:46.068347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:46.089936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53360ded-c400-4d5c-b3be-03e9f294da23 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:46.093704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:46.094374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:46.094657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:46.094983 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:46.108232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:46.109878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:46.121373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1054/2163] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:46.387052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:46.388844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:46.424779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c239b14-5e89-46b0-a87c-ce4740b6764e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:46.448329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:46.450861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:46.452096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:46.452454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] PATH_INFO: `/v3/projects/da9a5633d7a24bf3bdbbed8a866b99de` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:46.453911 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9a5633d7a24bf3bdbbed8a866b99de)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:46.460366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:46.478620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:46.588876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9a5633d7a24bf3bdbbed8a866b99de', 'request_id': 'req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:46.598099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9a5633d7a24bf3bdbbed8a866b99de', 'request_id': 'req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:46.613112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9a5633d7a24bf3bdbbed8a866b99de', 'request_id': 'req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:46.740699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] The token cache is being invalidate because project da9a5633d7a24bf3bdbbed8a866b99de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:46.741002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:46.742910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:46.743567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:46.744731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:46.750909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1110/2164] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:46 2022] DELETE /identity/v3/projects/da9a5633d7a24bf3bdbbed8a866b99de => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:46.751488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:46.756078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:46.765642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979b32-35de-45a3-b1aa-eb257bdd8313 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:46.830886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:46.831765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:46.832043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:46.832506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] PATH_INFO: `/v3/projects/2825c0be61f641e1b242f8f9457154c2` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:46.833702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2825c0be61f641e1b242f8f9457154c2)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:46.835329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7577d2-7118-4c0e-b1e3-49985c8ac0ea admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:46.835859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:46.840989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:46.841860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:46.842150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:46.842426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] PATH_INFO: `/v3/users/04c7d9ba063e4933bdf55a6e9fddbb3b` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:46.843758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c7d9ba063e4933bdf55a6e9fddbb3b)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:46.845827 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:46.953474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2825c0be61f641e1b242f8f9457154c2', 'request_id': 'req-15c57ae4-a977-4a2c-9d8a-6042eac41a25'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:46.960063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2825c0be61f641e1b242f8f9457154c2', 'request_id': 'req-15c57ae4-a977-4a2c-9d8a-6042eac41a25'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:46.966314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2825c0be61f641e1b242f8f9457154c2', 'request_id': 'req-15c57ae4-a977-4a2c-9d8a-6042eac41a25'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.053483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] The token cache is being invalidate because project 2825c0be61f641e1b242f8f9457154c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:47.054628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.055611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-15c57ae4-a977-4a2c-9d8a-6042eac41a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.058023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1055/2165] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:46 2022] DELETE /identity/v3/projects/2825c0be61f641e1b242f8f9457154c2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:47.062787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4a9e-db88-4652-bd32-3e1f61f9efbb None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.063122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4a9e-db88-4652-bd32-3e1f61f9efbb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.063549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4a9e-db88-4652-bd32-3e1f61f9efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.064574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c7d9ba063e4933bdf55a6e9fddbb3b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.071678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c7d9ba063e4933bdf55a6e9fddbb3b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.072429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c7d9ba063e4933bdf55a6e9fddbb3b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.073655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c7d9ba063e4933bdf55a6e9fddbb3b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.083320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-07cf4a9e-db88-4652-bd32-3e1f61f9efbb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:47.088235 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-07cf4a9e-db88-4652-bd32-3e1f61f9efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:47.088338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c7d9ba063e4933bdf55a6e9fddbb3b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.148219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1056/2166] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:47.156483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0587c5-f8dc-4df8-a9b7-f7e1638e137f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.156804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0587c5-f8dc-4df8-a9b7-f7e1638e137f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.157165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0587c5-f8dc-4df8-a9b7-f7e1638e137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.174908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9f0587c5-f8dc-4df8-a9b7-f7e1638e137f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:47.176136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9f0587c5-f8dc-4df8-a9b7-f7e1638e137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:47.183972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1111/2167] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:46 2022] DELETE /identity/v3/users/04c7d9ba063e4933bdf55a6e9fddbb3b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:47.188440 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1057/2168] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:47.194033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.231341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:47.274135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26341009-998e-4d4f-9fe5-869caa5d2c34 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.279856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.280547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.280837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.281120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.281848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:47.282154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.283921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.300798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1112/2169] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:47.300913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0587c5-f8dc-4df8-a9b7-f7e1638e137f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.311082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0587c5-f8dc-4df8-a9b7-f7e1638e137f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.316070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.316844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.317134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.317413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.318109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.320122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.332698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:47.444476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1058/2170] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:47 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:47.449302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.468721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2a64c-59ba-4c27-91ed-8ccf0339c0f6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.535881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.536549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.537109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.537509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.538261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.540222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.642640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1113/2171] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:47 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:47.646224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.656553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa40f9-2620-4d74-98fd-0c1eb770fa81 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.661127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.661791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.662074 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.662357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.663153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.664758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.676714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1059/2172] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:47.680882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.681076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.683931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:47.702661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a73167-c624-4140-93d4-670f512362e3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.708004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68fb49-0c8c-474e-9b2b-4d6911cc5bf1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.712655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.713464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.713574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.713798 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.714253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.714495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.714884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.715239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] PATH_INFO: `/v3/projects/5fab0361b30c40bfab8e2ca5d4291222` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.717086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fab0361b30c40bfab8e2ca5d4291222)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.717905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.719329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.720273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.736962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1114/2173] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:47.738572 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.755577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b9fe-06f5-46cf-9014-87c83c82e98d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.761516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534701e2-6f67-4972-b7d5-0d77e2f05d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.762538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534701e2-6f67-4972-b7d5-0d77e2f05d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.763016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534701e2-6f67-4972-b7d5-0d77e2f05d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.763353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534701e2-6f67-4972-b7d5-0d77e2f05d01 admin admin] PATH_INFO: `/v3/projects/272355630b2949e9b340ce558c6a3678/users/e09664b3100d47cd832dd282024c45ed/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.780655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534701e2-6f67-4972-b7d5-0d77e2f05d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272355630b2949e9b340ce558c6a3678, user_id=e09664b3100d47cd832dd282024c45ed, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.783360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534701e2-6f67-4972-b7d5-0d77e2f05d01 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.909865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1115/2174] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:47 2022] PUT /identity/v3/projects/272355630b2949e9b340ce558c6a3678/users/e09664b3100d47cd832dd282024c45ed/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:47.920561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.920855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.921135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.921610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fab0361b30c40bfab8e2ca5d4291222', 'request_id': 'req-37e705db-c181-4598-804e-7dc5186d1383'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.927928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fab0361b30c40bfab8e2ca5d4291222', 'request_id': 'req-37e705db-c181-4598-804e-7dc5186d1383'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.934063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fab0361b30c40bfab8e2ca5d4291222', 'request_id': 'req-37e705db-c181-4598-804e-7dc5186d1383'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.947486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] MFA Rules not processed for user `e09664b3100d47cd832dd282024c45ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:47.949743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:47.990563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] The token cache is being invalidate because project 5fab0361b30c40bfab8e2ca5d4291222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:47.995709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.995709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-37e705db-c181-4598-804e-7dc5186d1383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.995709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1060/2175] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:47 2022] DELETE /identity/v3/projects/5fab0361b30c40bfab8e2ca5d4291222 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:47.999110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb45d9-acde-4974-a80f-f0387fc5df75 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.999471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb45d9-acde-4974-a80f-f0387fc5df75 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.999847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb45d9-acde-4974-a80f-f0387fc5df75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.020285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6fbb45d9-acde-4974-a80f-f0387fc5df75 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:48.021523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6fbb45d9-acde-4974-a80f-f0387fc5df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:48.028087 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1116/2176] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:48.038549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.039918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:48.046151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:48.089555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1061/2177] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:48.097948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115031c6-753f-4c72-8b48-1f24ba3d22c0 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.098240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115031c6-753f-4c72-8b48-1f24ba3d22c0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.098518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115031c6-753f-4c72-8b48-1f24ba3d22c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.110125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696494b8-7578-4038-a55f-d7ee811a1b69 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.114431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.115124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.115415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.115699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.118000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-115031c6-753f-4c72-8b48-1f24ba3d22c0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:48.119316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-115031c6-753f-4c72-8b48-1f24ba3d22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:48.127533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.128870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1062/2178] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:48.129074 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.133207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115031c6-753f-4c72-8b48-1f24ba3d22c0 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.140288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1117/2179] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:48.143554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115031c6-753f-4c72-8b48-1f24ba3d22c0 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.148263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.148920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.149200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.149475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.150212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:48.150519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.153278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.170919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1063/2180] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:48.171080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.180595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beeec5-139f-40c3-9ec8-2cb812f1dc44 service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.185462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.186459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.186809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.187174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.188158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.193782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.277500 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1118/2181] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:48 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:48.288970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.304206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9c58e-162b-449a-8b39-07693c7a8524 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.345625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:48.363653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.365938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.365938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.365938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.365938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.367649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.450015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1064/2182] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:48 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:48.451387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.471384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679a26-09d1-46eb-870c-16899ba3d230 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.476695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.477455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.477756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.478039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.478944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.481215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.493994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1119/2183] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:48.498004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.521003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706b1e1-8a01-40d5-a0ec-191357365179 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.526125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d7db5-46d2-42c1-82d5-5d718c4b668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.526669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7db5-46d2-42c1-82d5-5d718c4b668a admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.527881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7db5-46d2-42c1-82d5-5d718c4b668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.527881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7db5-46d2-42c1-82d5-5d718c4b668a admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.528841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d7db5-46d2-42c1-82d5-5d718c4b668a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.530535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d7db5-46d2-42c1-82d5-5d718c4b668a admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.542195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1065/2184] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:48.546438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.556895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d7b3-a4ff-4a97-8b22-0e1ae6a420a0 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.562179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.567354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.567354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.567354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] PATH_INFO: `/v3/projects/992bcbef1d4c43f598e7cb7dcc076077/users/f093ca07da7d42e7b1c303c54c2034ec/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.579624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] RBAC: Authorizing `identity:create_grant(project_id=992bcbef1d4c43f598e7cb7dcc076077, user_id=f093ca07da7d42e7b1c303c54c2034ec, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.582339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.643914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1120/2185] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:48 2022] PUT /identity/v3/projects/992bcbef1d4c43f598e7cb7dcc076077/users/f093ca07da7d42e7b1c303c54c2034ec/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:48.655194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.655505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.655792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.681302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] MFA Rules not processed for user `f093ca07da7d42e7b1c303c54c2034ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:48.682519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:48.749903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1066/2186] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:48.761910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.763687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:48.852767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3c86-d133-44e4-ba9d-d3e49c5a162c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.856747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d6a41-d1f8-4b7c-b4ee-bd4f652640b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.857477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d6a41-d1f8-4b7c-b4ee-bd4f652640b0 service glance] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.857800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d6a41-d1f8-4b7c-b4ee-bd4f652640b0 service glance] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.858253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d6a41-d1f8-4b7c-b4ee-bd4f652640b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.868659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d6a41-d1f8-4b7c-b4ee-bd4f652640b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.869743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d6a41-d1f8-4b7c-b4ee-bd4f652640b0 service glance] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.880463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1121/2187] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:52.258518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:52.260708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:52.324844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce36e80-7205-4efc-a487-d47e4d4515e5 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:52.329299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:52.330165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:52.330451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:52.330729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] PATH_INFO: `/v3/users/e09664b3100d47cd832dd282024c45ed` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:52.331946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09664b3100d47cd832dd282024c45ed)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:52.333864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:52.528356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09664b3100d47cd832dd282024c45ed'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:52.533363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:52.589577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09664b3100d47cd832dd282024c45ed'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:52.598181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09664b3100d47cd832dd282024c45ed'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:52.599103 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09664b3100d47cd832dd282024c45ed'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:52.599758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09664b3100d47cd832dd282024c45ed'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:52.622629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1067/2188] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:52 2022] DELETE /identity/v3/users/e09664b3100d47cd832dd282024c45ed => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:52.627442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:52.627970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:52.628079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:52.647371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:52.648661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:52.696069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:52.714730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1122/2189] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:52.727167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:52.728620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:52.793101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dde96-1bc6-477a-a39e-ed067d285eec admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:52.797210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3e652-ead9-4481-abc4-3a1df5e547b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:52.797864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e652-ead9-4481-abc4-3a1df5e547b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:52.798340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e652-ead9-4481-abc4-3a1df5e547b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:52.798629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e652-ead9-4481-abc4-3a1df5e547b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:52.808617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3e652-ead9-4481-abc4-3a1df5e547b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:52.810089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3e652-ead9-4481-abc4-3a1df5e547b1 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:52.820203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1068/2190] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:53.199126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:53.201918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:53.221431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1849173-65df-46df-923d-7669f33afdd9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:53.227804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:53.228457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.228858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.229259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] PATH_INFO: `/v3/projects/272355630b2949e9b340ce558c6a3678` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.231395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=272355630b2949e9b340ce558c6a3678)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:53.233549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:53.361516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272355630b2949e9b340ce558c6a3678', 'request_id': 'req-38eac157-d72f-45c2-9849-76d4954e1c34'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:53.372300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272355630b2949e9b340ce558c6a3678', 'request_id': 'req-38eac157-d72f-45c2-9849-76d4954e1c34'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:53.378776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272355630b2949e9b340ce558c6a3678', 'request_id': 'req-38eac157-d72f-45c2-9849-76d4954e1c34'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:53.492260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] The token cache is being invalidate because project 272355630b2949e9b340ce558c6a3678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:53.492471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:53.493057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-38eac157-d72f-45c2-9849-76d4954e1c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:53.494618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1123/2191] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:53 2022] DELETE /identity/v3/projects/272355630b2949e9b340ce558c6a3678 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:53.500067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a4fb-b764-468e-8f94-37e34c68ac99 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.500548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a4fb-b764-468e-8f94-37e34c68ac99 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.500639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a4fb-b764-468e-8f94-37e34c68ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.520269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-df47a4fb-b764-468e-8f94-37e34c68ac99 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:53.521483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-df47a4fb-b764-468e-8f94-37e34c68ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:53.584431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1069/2192] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:53.592617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8aeb-86ee-4faa-a969-71d57fbc6f8d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.592915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8aeb-86ee-4faa-a969-71d57fbc6f8d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.593198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb8aeb-86ee-4faa-a969-71d57fbc6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.612679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-96bb8aeb-86ee-4faa-a969-71d57fbc6f8d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:53.613892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-96bb8aeb-86ee-4faa-a969-71d57fbc6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:53.622233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1124/2193] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:53.626399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a4fb-b764-468e-8f94-37e34c68ac99 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:53.636622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a4fb-b764-468e-8f94-37e34c68ac99 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:53.642536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:53.643249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.643539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.643876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.644624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:53.644937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:53.646600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:53.658669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1070/2194] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:53.663025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb8aeb-86ee-4faa-a969-71d57fbc6f8d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:53.677968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb8aeb-86ee-4faa-a969-71d57fbc6f8d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:53.684231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:53.684977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.685465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.685746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.686661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:53.688768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:53.774611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1125/2195] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:53 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:53.778238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:53.789308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01898789-14f1-4b9b-a112-dc3ef6a47258 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:53.851028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:53.851969 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.852246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.852564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.853266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:53.855195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:53.862584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:53.958582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1071/2196] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:53 2022] POST /identity/v3/users => generated 282 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:53.967107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:53.981725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82bef5-5ae4-4b32-a618-7b74c41be2c1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:53.988624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:53.989446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.989824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.990177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.991028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:53.992819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:54.004728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1126/2197] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:54.008773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:54.019494 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a0bdd-c392-4fc3-acc8-d26695da4b66 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:54.024722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241885a-7eba-4ab8-bad5-5f1064f83c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:54.025429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241885a-7eba-4ab8-bad5-5f1064f83c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:54.025776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241885a-7eba-4ab8-bad5-5f1064f83c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:54.026117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241885a-7eba-4ab8-bad5-5f1064f83c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:54.026964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241885a-7eba-4ab8-bad5-5f1064f83c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:54.028780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241885a-7eba-4ab8-bad5-5f1064f83c10 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:54.038977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1072/2198] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:54.044808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:54.055755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7183-4a01-476e-90fc-93ffd4744592 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:54.061072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:54.062007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:54.062299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:54.062579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] PATH_INFO: `/v3/projects/43b26056443d4ed69be3c2d634928a3f/users/69e16683897141389e7024156d910812/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:54.077322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b26056443d4ed69be3c2d634928a3f, user_id=69e16683897141389e7024156d910812, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:54.080238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:54.144309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1127/2199] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:54 2022] PUT /identity/v3/projects/43b26056443d4ed69be3c2d634928a3f/users/69e16683897141389e7024156d910812/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:54.157006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b423b-8c54-4d34-804d-8f673e8e7e09 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:54.157310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b423b-8c54-4d34-804d-8f673e8e7e09 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:54.157586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b423b-8c54-4d34-804d-8f673e8e7e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:54.184923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-349b423b-8c54-4d34-804d-8f673e8e7e09 None None] MFA Rules not processed for user `69e16683897141389e7024156d910812`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:54.186140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-349b423b-8c54-4d34-804d-8f673e8e7e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:54.249617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1073/2200] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:08:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:54.260809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:54.262514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:54.330352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881a694-48f7-4772-9941-7a75584b00e3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:54.334078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03d8ae-3f8f-44d2-b4a6-2c924f15ee09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:54.334727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03d8ae-3f8f-44d2-b4a6-2c924f15ee09 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:54.335040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03d8ae-3f8f-44d2-b4a6-2c924f15ee09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:54.335319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03d8ae-3f8f-44d2-b4a6-2c924f15ee09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:54.344347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03d8ae-3f8f-44d2-b4a6-2c924f15ee09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:54.345839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03d8ae-3f8f-44d2-b4a6-2c924f15ee09 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:54.358948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1128/2201] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:04.246518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:04.353395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:26.728031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:26.728533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:26.728628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:26.745992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] MFA Rules not processed for user `71ac6423996b4e5d906de9ff6986fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:26.747256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:26.802811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1074/2202] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:36.795687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=25 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:41.869222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533b15d-0f30-4517-9597-63c12adcb8f3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:41.869727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533b15d-0f30-4517-9597-63c12adcb8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:41.869840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533b15d-0f30-4517-9597-63c12adcb8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:41.897321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d533b15d-0f30-4517-9597-63c12adcb8f3 None None] MFA Rules not processed for user `0673a8903f56430f86f87b9447668300`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:41.898515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d533b15d-0f30-4517-9597-63c12adcb8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:41.977967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1129/2203] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:42.421413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:42.422994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:42.560502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda146c-b7c4-4e11-9bb3-5bb05a348060 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:42.565467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:42.566420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:42.566773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:42.567152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] PATH_INFO: `/v3/users/f093ca07da7d42e7b1c303c54c2034ec` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:42.568470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f093ca07da7d42e7b1c303c54c2034ec)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:42.570456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:42.748647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f093ca07da7d42e7b1c303c54c2034ec'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:42.827254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f093ca07da7d42e7b1c303c54c2034ec'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:42.834920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f093ca07da7d42e7b1c303c54c2034ec'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:42.835555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f093ca07da7d42e7b1c303c54c2034ec'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:42.836156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f093ca07da7d42e7b1c303c54c2034ec'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:42.854081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1075/2204] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:09:42 2022] DELETE /identity/v3/users/f093ca07da7d42e7b1c303c54c2034ec => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:42.859450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:42.859807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:42.860147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:42.888072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:42.889423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:42.972070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1130/2205] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:42.982391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:42.983880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:43.013664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:43.092860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc62865-fd75-4e95-aed3-06b3bd6a2f3e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:43.098003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a6c32-5138-4c6d-8332-8b3e909d7897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:43.098661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a6c32-5138-4c6d-8332-8b3e909d7897 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:43.098988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a6c32-5138-4c6d-8332-8b3e909d7897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:43.099265 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a6c32-5138-4c6d-8332-8b3e909d7897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:43.110032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a6c32-5138-4c6d-8332-8b3e909d7897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:43.111054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a6c32-5138-4c6d-8332-8b3e909d7897 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:43.122208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1076/2206] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:43.684757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:43.684757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:43.700193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8435f9-bda5-4ccf-b4c1-79162839ce1e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:43.706070 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:43.707183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:43.707609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:43.708029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] PATH_INFO: `/v3/projects/992bcbef1d4c43f598e7cb7dcc076077` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:43.713081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] RBAC: Authorizing `identity:delete_project(project_id=992bcbef1d4c43f598e7cb7dcc076077)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:43.713081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:43.869554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992bcbef1d4c43f598e7cb7dcc076077', 'request_id': 'req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:43.875912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992bcbef1d4c43f598e7cb7dcc076077', 'request_id': 'req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:43.882630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992bcbef1d4c43f598e7cb7dcc076077', 'request_id': 'req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:43.890869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:43.995069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] The token cache is being invalidate because project 992bcbef1d4c43f598e7cb7dcc076077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:09:43.995807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:43.996539 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b11b7e2-6d67-4f5a-81b5-7c7e95b9172e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:43.998225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1131/2207] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:09:43 2022] DELETE /identity/v3/projects/992bcbef1d4c43f598e7cb7dcc076077 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:44.005586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f44c-d43a-433a-9ef1-48d9e3aad075 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.005586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f44c-d43a-433a-9ef1-48d9e3aad075 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.005586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f44c-d43a-433a-9ef1-48d9e3aad075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.045696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-48f0f44c-d43a-433a-9ef1-48d9e3aad075 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:44.046955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-48f0f44c-d43a-433a-9ef1-48d9e3aad075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:44.112761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1077/2208] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:44.121368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb767-b1e1-4bfe-b8ae-0599f488880e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.121665 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb767-b1e1-4bfe-b8ae-0599f488880e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.121955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb767-b1e1-4bfe-b8ae-0599f488880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.152496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d73bb767-b1e1-4bfe-b8ae-0599f488880e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:44.154312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d73bb767-b1e1-4bfe-b8ae-0599f488880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:44.176020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1132/2209] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:44.177561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0f44c-d43a-433a-9ef1-48d9e3aad075 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:44.197170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0f44c-d43a-433a-9ef1-48d9e3aad075 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:44.202505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:44.203222 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.204701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.204701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.204701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:09:44.204993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:44.206690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:44.222717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1078/2210] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:09:44.225021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb767-b1e1-4bfe-b8ae-0599f488880e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:44.237441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb767-b1e1-4bfe-b8ae-0599f488880e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:44.242604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:44.243619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.243986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.244381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.245327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:44.247997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:44.333322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1133/2211] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:09:44.334506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:44.345850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d62593-8408-480c-8a5e-704a82730ac8 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:44.404011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:44.410626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:44.411814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.412102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.412381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.413207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:44.416571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:44.498491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1079/2212] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:09:44 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:09:44.502465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:44.513619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a201b1-486f-4633-a488-4ec2fcd6646f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:44.518944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:44.519872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.520163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.520447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.521212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:44.522910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:44.533561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1134/2213] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:09:44.542439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:44.561470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a108e5c-a5d5-4f46-a359-e2d1443f56b5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:44.566455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8feb0-42da-4257-9d20-42dca51e8045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:44.567145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8feb0-42da-4257-9d20-42dca51e8045 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.567473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8feb0-42da-4257-9d20-42dca51e8045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.567697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8feb0-42da-4257-9d20-42dca51e8045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.568423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8feb0-42da-4257-9d20-42dca51e8045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:44.570019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8feb0-42da-4257-9d20-42dca51e8045 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:44.581262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1080/2214] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:09:44.589186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:44.599708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8e5ac-c424-4c09-905d-3edf244288ef admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:44.609986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:44.610904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.611194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.611472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] PATH_INFO: `/v3/projects/ed7f3e35bb9a4f2ea707996c3c46acfb/users/a7bc17464f3346d0aba238a2dee0dc47/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.627674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7f3e35bb9a4f2ea707996c3c46acfb, user_id=a7bc17464f3346d0aba238a2dee0dc47, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:44.630397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:44.706745 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1135/2215] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:09:44 2022] PUT /identity/v3/projects/ed7f3e35bb9a4f2ea707996c3c46acfb/users/a7bc17464f3346d0aba238a2dee0dc47/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:44.711800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.712117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.712420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.730161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:44.731393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:44.790618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1081/2216] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:44.799965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:44.801650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:44.861030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb789cf-8151-4453-81c3-46547de5b11f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:44.865144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e21482-24f4-4fe8-9ce5-0f323965b8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:44.866489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21482-24f4-4fe8-9ce5-0f323965b8db service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:44.866916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21482-24f4-4fe8-9ce5-0f323965b8db service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:44.867298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21482-24f4-4fe8-9ce5-0f323965b8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:44.876737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e21482-24f4-4fe8-9ce5-0f323965b8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:44.878282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e21482-24f4-4fe8-9ce5-0f323965b8db service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:44.889168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1136/2217] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:49.311036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:49.312782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:49.331900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f227f14-1399-4ea9-a420-841d98f8fa1b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:49.345518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f77abe-b711-441b-a969-2490723366da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:49.346987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f77abe-b711-441b-a969-2490723366da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:49.347276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f77abe-b711-441b-a969-2490723366da admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:49.347555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f77abe-b711-441b-a969-2490723366da admin admin] PATH_INFO: `/v3/users/69e16683897141389e7024156d910812` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:49.350512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f77abe-b711-441b-a969-2490723366da admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e16683897141389e7024156d910812)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:49.358132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f77abe-b711-441b-a969-2490723366da admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:49.554239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e16683897141389e7024156d910812'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:49.644755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e16683897141389e7024156d910812'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:49.655205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e16683897141389e7024156d910812'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:49.656186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e16683897141389e7024156d910812'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:49.656818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e16683897141389e7024156d910812'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:49.681936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1082/2218] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:09:49 2022] DELETE /identity/v3/users/69e16683897141389e7024156d910812 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:49.686753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:49.687284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:49.687486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:49.708662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:49.710097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:49.780633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1137/2219] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:49.792643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:49.797941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:49.860689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:49.865450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f77abe-b711-441b-a969-2490723366da admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:49.870135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27805b8-bb63-4c00-98ba-1be73d2d589c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:49.871007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27805b8-bb63-4c00-98ba-1be73d2d589c service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:49.871402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27805b8-bb63-4c00-98ba-1be73d2d589c service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:49.871786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27805b8-bb63-4c00-98ba-1be73d2d589c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:49.882600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27805b8-bb63-4c00-98ba-1be73d2d589c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:49.884280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27805b8-bb63-4c00-98ba-1be73d2d589c service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:49.896708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1083/2220] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:50.333049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:50.334558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:50.389016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef58c8-ab2a-4424-b3ce-90a0d807ed2d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:50.389846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:50.390734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:50.390945 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:50.391636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] PATH_INFO: `/v3/projects/43b26056443d4ed69be3c2d634928a3f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:50.392943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b26056443d4ed69be3c2d634928a3f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:50.395015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:50.466949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:50.467403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:50.467597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:50.497395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] MFA Rules not processed for user `a7bc17464f3346d0aba238a2dee0dc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:50.498707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:50.547427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:50.577657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b26056443d4ed69be3c2d634928a3f', 'request_id': 'req-fb53920e-b658-4c98-9edb-9cf3c89d3072'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:50.587767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b26056443d4ed69be3c2d634928a3f', 'request_id': 'req-fb53920e-b658-4c98-9edb-9cf3c89d3072'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:50.601762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b26056443d4ed69be3c2d634928a3f', 'request_id': 'req-fb53920e-b658-4c98-9edb-9cf3c89d3072'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:50.623593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1084/2221] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:09:50.628301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:50.629858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:50.645608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d4516-710b-4736-8e25-1c27d8ed06b2 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:50.696800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] The token cache is being invalidate because project 43b26056443d4ed69be3c2d634928a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:09:50.700262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:50.700262 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:50.710989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:50.711476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1138/2222] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:09:50 2022] DELETE /identity/v3/projects/43b26056443d4ed69be3c2d634928a3f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:50.712023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:50.712384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:50.712743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:50.713536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:50.715731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:50.803439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1085/2223] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:09:50.806809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:50.818153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:50.832925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53920e-b658-4c98-9edb-9cf3c89d3072 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:50.905936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:50.906992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:50.909998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:50.909998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:50.909998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:50.910991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:50.993271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1139/2224] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:09:50 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:09:50.997947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:51.008689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502745-c831-42a1-ada1-1ac507c583b8 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:51.014754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:51.015197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:51.015548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:51.015896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:51.016726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:51.018425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:51.030403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1086/2225] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:09:51.039393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:51.049780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9c593-3094-4a25-beee-6aaa108b3135 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:51.055048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:51.055888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:51.056176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:51.056454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] PATH_INFO: `/v3/projects/911a19628e5b4b3480c7a5c83c4d8504/users/a537e262dded4fdf9681f754bfdf4d16/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:51.072336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911a19628e5b4b3480c7a5c83c4d8504, user_id=a537e262dded4fdf9681f754bfdf4d16, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:51.075051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:51.147507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1140/2226] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:09:51 2022] PUT /identity/v3/projects/911a19628e5b4b3480c7a5c83c4d8504/users/a537e262dded4fdf9681f754bfdf4d16/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:51.151497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:51.161535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed988b-f406-4d5e-8fb7-3bef9d800e0e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:51.225781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:51.233502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d2a1f-66f8-4240-9e00-11f422ae803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:51.238747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d2a1f-66f8-4240-9e00-11f422ae803e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:51.238747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d2a1f-66f8-4240-9e00-11f422ae803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:51.238747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d2a1f-66f8-4240-9e00-11f422ae803e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:51.238747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d2a1f-66f8-4240-9e00-11f422ae803e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:51.238747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d2a1f-66f8-4240-9e00-11f422ae803e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:51.250372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1087/2227] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:09:51.251552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:51.262049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8656c-080a-46e4-aba0-292e262b5ec9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:51.266675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:51.267776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:51.268072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:51.268360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] PATH_INFO: `/v3/projects/911a19628e5b4b3480c7a5c83c4d8504/users/a537e262dded4fdf9681f754bfdf4d16/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:51.270367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=911a19628e5b4b3480c7a5c83c4d8504, user_id=a537e262dded4fdf9681f754bfdf4d16, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:51.273109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:51.284440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1141/2228] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:09:51 2022] PUT /identity/v3/projects/911a19628e5b4b3480c7a5c83c4d8504/users/a537e262dded4fdf9681f754bfdf4d16/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:59.095483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f446525-ac5f-440d-9531-504ea4147936 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:59.096053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f446525-ac5f-440d-9531-504ea4147936 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:59.096053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f446525-ac5f-440d-9531-504ea4147936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:59.126709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3f446525-ac5f-440d-9531-504ea4147936 None None] MFA Rules not processed for user `a537e262dded4fdf9681f754bfdf4d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:59.127910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3f446525-ac5f-440d-9531-504ea4147936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:59.202592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1088/2229] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:09:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:59.216605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:59.218431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:59.289703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:59.322156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b2f87-47ea-46fb-9ebe-5af1b87b96bf admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:59.328427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:59.329269 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:59.329618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:59.330106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:59.332292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:59.395702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:59.397427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:59.408689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1142/2230] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:01.880373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe596-6039-4b86-bf3b-5cbe4b863780 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:01.880885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe596-6039-4b86-bf3b-5cbe4b863780 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:01.881091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe596-6039-4b86-bf3b-5cbe4b863780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:01.903484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-04bfe596-6039-4b86-bf3b-5cbe4b863780 None None] MFA Rules not processed for user `a7bc17464f3346d0aba238a2dee0dc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:01.904882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-04bfe596-6039-4b86-bf3b-5cbe4b863780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:01.912046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1089/2231] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:10:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:09.402401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=36 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:11.897356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=41 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:16.911117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:16.912764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:17.007784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a518ec0-aee1-4954-ab5b-15dff4698df9 service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:17.012762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b857-2f3f-4bfd-94db-b1217c7f56b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:17.013401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b857-2f3f-4bfd-94db-b1217c7f56b1 service placement] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:17.013689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b857-2f3f-4bfd-94db-b1217c7f56b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:17.013979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b857-2f3f-4bfd-94db-b1217c7f56b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:17.015717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4c56b857-2f3f-4bfd-94db-b1217c7f56b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:17.026579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b857-2f3f-4bfd-94db-b1217c7f56b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:17.028204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b857-2f3f-4bfd-94db-b1217c7f56b1 service placement] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:17.037705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1143/2232] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:10:27.033707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=41 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:29.009978 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:29.010421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:29.010536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:29.028613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] MFA Rules not processed for user `4468a51c478d4fd38f2bc3066dff63ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:29.029805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:29.082527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1090/2233] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:10:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:32.887180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b3317-8233-482f-8895-fc708dbb96f6 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:32.887661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b3317-8233-482f-8895-fc708dbb96f6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:32.887753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b3317-8233-482f-8895-fc708dbb96f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:32.953291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-db8b3317-8233-482f-8895-fc708dbb96f6 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:32.954530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-db8b3317-8233-482f-8895-fc708dbb96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:33.031015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1144/2234] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:33.084597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:33.086097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:33.181072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374f1c3-ccf5-4eeb-be55-43bf2f2fe9c9 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:33.186282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631c57c-426f-414a-a685-a23b8308d0c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:33.186974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c57c-426f-414a-a685-a23b8308d0c9 service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:33.187266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c57c-426f-414a-a685-a23b8308d0c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:33.187572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c57c-426f-414a-a685-a23b8308d0c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:33.196617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631c57c-426f-414a-a685-a23b8308d0c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:33.198247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631c57c-426f-414a-a685-a23b8308d0c9 service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:33.207501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1091/2235] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:10:43.027597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=44 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:43.204045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=66 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:50.474557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81052-ee98-415e-908e-ece53601745b None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:50.475435 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81052-ee98-415e-908e-ece53601745b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:50.475582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b81052-ee98-415e-908e-ece53601745b None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:50.477028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1145/2236] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:10:50.483176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486115d-f37e-4b26-8da0-ab8f88dc2c2d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:50.483630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486115d-f37e-4b26-8da0-ab8f88dc2c2d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:50.483878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486115d-f37e-4b26-8da0-ab8f88dc2c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:50.532985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c486115d-f37e-4b26-8da0-ab8f88dc2c2d None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:50.534263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c486115d-f37e-4b26-8da0-ab8f88dc2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:50.544189 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1092/2237] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:10:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:50.555904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81052-ee98-415e-908e-ece53601745b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:50.557627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c2b81052-ee98-415e-908e-ece53601745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:50.640249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b81052-ee98-415e-908e-ece53601745b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:50.644322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9564d4-3603-49b4-a3b6-7861dfbf6275 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:50.645037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9564d4-3603-49b4-a3b6-7861dfbf6275 service glance] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:50.645344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9564d4-3603-49b4-a3b6-7861dfbf6275 service glance] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:50.645622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9564d4-3603-49b4-a3b6-7861dfbf6275 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:50.656206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9564d4-3603-49b4-a3b6-7861dfbf6275 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:50.657619 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9564d4-3603-49b4-a3b6-7861dfbf6275 service glance] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:50.669079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1146/2238] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:50.844514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c353b52-0d88-4bfb-b4be-c7939bb7beac None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:50.844889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c353b52-0d88-4bfb-b4be-c7939bb7beac None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:50.845174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c353b52-0d88-4bfb-b4be-c7939bb7beac None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:50.846589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1093/2239] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:10:50.851538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cdb54-842e-4646-8ed8-07ee52462af7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:50.851867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cdb54-842e-4646-8ed8-07ee52462af7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:50.852151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cdb54-842e-4646-8ed8-07ee52462af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:50.870684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b72cdb54-842e-4646-8ed8-07ee52462af7 None None] MFA Rules not processed for user `c6bbb0e4d7ca44fc8cb68fdc96260caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:50.872494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b72cdb54-842e-4646-8ed8-07ee52462af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:50.922487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1147/2240] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:10:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:50.934903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c353b52-0d88-4bfb-b4be-c7939bb7beac None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:50.936622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8c353b52-0d88-4bfb-b4be-c7939bb7beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:50.949880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c353b52-0d88-4bfb-b4be-c7939bb7beac None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:50.953347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81fed2-3247-4735-82fe-9598693a3c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:50.954013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81fed2-3247-4735-82fe-9598693a3c64 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:50.954293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81fed2-3247-4735-82fe-9598693a3c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:50.954566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81fed2-3247-4735-82fe-9598693a3c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:50.961600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81fed2-3247-4735-82fe-9598693a3c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:50.963038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81fed2-3247-4735-82fe-9598693a3c64 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:50.971392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1094/2241] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:51.081146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606cd5d-7b62-45e9-80c5-38f2e378c411 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:51.081438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606cd5d-7b62-45e9-80c5-38f2e378c411 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:51.081717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606cd5d-7b62-45e9-80c5-38f2e378c411 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:51.083172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1148/2242] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:10:51.088585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:51.088878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:51.089190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:51.108522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:51.109652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:51.118786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1095/2243] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:10:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:51.129470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606cd5d-7b62-45e9-80c5-38f2e378c411 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:51.140630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606cd5d-7b62-45e9-80c5-38f2e378c411 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:51.144102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71aaa-ad42-40d3-8473-e33a6637f822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:51.144756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71aaa-ad42-40d3-8473-e33a6637f822 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:51.145039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71aaa-ad42-40d3-8473-e33a6637f822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:51.145314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71aaa-ad42-40d3-8473-e33a6637f822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:51.155200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71aaa-ad42-40d3-8473-e33a6637f822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:51.156627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71aaa-ad42-40d3-8473-e33a6637f822 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:51.167043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1149/2244] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:53.273461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:53.274911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:53.286668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379245-43d2-41c6-a64a-9d98e79e1d03 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:53.290143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:53.290780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:53.291100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:53.291379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:53.300742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:53.302164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:53.311559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1096/2245] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:01.162603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=64 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:03.307396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=28 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:03.993628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234824e-0d2d-47ef-8e83-edda1ce0f547 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:03.994126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234824e-0d2d-47ef-8e83-edda1ce0f547 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:03.994319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234824e-0d2d-47ef-8e83-edda1ce0f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:04.014542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-1234824e-0d2d-47ef-8e83-edda1ce0f547 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:04.015793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1234824e-0d2d-47ef-8e83-edda1ce0f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:04.023245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1150/2246] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:11:04.036229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:04.048489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec0dc-8c17-4f5f-8a55-ff1b820022b3 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:04.053927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:04.054582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:04.054901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:04.055191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:04.064410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:04.071618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:04.074968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1097/2247] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:11:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:11:14.008482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:14.070812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=6 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:34.542505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1407-b26e-4f2f-bd89-4967027f454e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:34.542505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1407-b26e-4f2f-bd89-4967027f454e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:34.542505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1407-b26e-4f2f-bd89-4967027f454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:34.562983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-366d1407-b26e-4f2f-bd89-4967027f454e None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:34.564544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-366d1407-b26e-4f2f-bd89-4967027f454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:34.573146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1151/2248] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 22 09:11:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:34.600734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:34.614159 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37e94-0f50-45de-97c5-ad2d59b45c39 service swift] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:34.620418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277793b1-9f1d-4189-a389-7f0d9e74b282 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:34.621083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277793b1-9f1d-4189-a389-7f0d9e74b282 service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:34.621368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277793b1-9f1d-4189-a389-7f0d9e74b282 service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:34.621648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277793b1-9f1d-4189-a389-7f0d9e74b282 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:34.633346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277793b1-9f1d-4189-a389-7f0d9e74b282 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:34.635007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277793b1-9f1d-4189-a389-7f0d9e74b282 service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:34.645695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1098/2249] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:11:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:11:39.461788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:39.462291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:39.462416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:39.481654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] MFA Rules not processed for user `0673a8903f56430f86f87b9447668300`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:39.481962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:39.537417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1152/2250] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:11:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:44.363950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee900c24-a931-4114-91bb-3e12b0bb50b3 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:44.363950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee900c24-a931-4114-91bb-3e12b0bb50b3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:44.363950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee900c24-a931-4114-91bb-3e12b0bb50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:44.385695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-ee900c24-a931-4114-91bb-3e12b0bb50b3 None None] MFA Rules not processed for user `71ac6423996b4e5d906de9ff6986fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:44.387115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ee900c24-a931-4114-91bb-3e12b0bb50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:44.446800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1099/2251] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:11:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:49.528666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=28 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:52.479414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:52.479414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:52.546176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f20a91-4ff3-4247-ac9e-b83cf14a4bae None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:52.550705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:52.551621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:52.551898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:52.552166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] PATH_INFO: `/v3/users/4468a51c478d4fd38f2bc3066dff63ff` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:52.553441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4468a51c478d4fd38f2bc3066dff63ff)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:52.555467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:52.748292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4468a51c478d4fd38f2bc3066dff63ff'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:52.755238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4468a51c478d4fd38f2bc3066dff63ff'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:52.761037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4468a51c478d4fd38f2bc3066dff63ff'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:52.761037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4468a51c478d4fd38f2bc3066dff63ff'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:52.768814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f39fcf30-1ac9-46cc-b78d-46a962153b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4468a51c478d4fd38f2bc3066dff63ff'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:52.850081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1153/2252] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:11:52 2022] DELETE /identity/v3/users/4468a51c478d4fd38f2bc3066dff63ff => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:11:53.096421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee900c24-a931-4114-91bb-3e12b0bb50b3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:53.109943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee900c24-a931-4114-91bb-3e12b0bb50b3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:53.167368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:53.168228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.168516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.168796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] PATH_INFO: `/v3/projects/05bd1375c6784f58a77c9b508ff282c9` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.170002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bd1375c6784f58a77c9b508ff282c9)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:53.171948 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:53.277349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bd1375c6784f58a77c9b508ff282c9', 'request_id': 'req-733639fb-eabf-4410-ac9b-5f881ca577db'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:53.285777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bd1375c6784f58a77c9b508ff282c9', 'request_id': 'req-733639fb-eabf-4410-ac9b-5f881ca577db'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:53.291596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bd1375c6784f58a77c9b508ff282c9', 'request_id': 'req-733639fb-eabf-4410-ac9b-5f881ca577db'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:53.368621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] The token cache is being invalidate because project 05bd1375c6784f58a77c9b508ff282c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:11:53.368916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:53.369538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-733639fb-eabf-4410-ac9b-5f881ca577db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:11:53.371124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1100/2253] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:11:53 2022] DELETE /identity/v3/projects/05bd1375c6784f58a77c9b508ff282c9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:53.376607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b52917-38e4-40a1-91de-96732c5ee345 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.377080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b52917-38e4-40a1-91de-96732c5ee345 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.377356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b52917-38e4-40a1-91de-96732c5ee345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.396783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-52b52917-38e4-40a1-91de-96732c5ee345 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:53.397992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-52b52917-38e4-40a1-91de-96732c5ee345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:53.456968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1154/2254] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:53.464733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20f69-eaa7-43d7-b9de-82df3a2c3c7b None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.465029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20f69-eaa7-43d7-b9de-82df3a2c3c7b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.465313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc20f69-eaa7-43d7-b9de-82df3a2c3c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.484958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1fc20f69-eaa7-43d7-b9de-82df3a2c3c7b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:53.486175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1fc20f69-eaa7-43d7-b9de-82df3a2c3c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:53.494338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1101/2255] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:53.498509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b52917-38e4-40a1-91de-96732c5ee345 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:53.508439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b52917-38e4-40a1-91de-96732c5ee345 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:53.513081 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:53.513741 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.514033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.514311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.515083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:11:53.515396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:53.517035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:53.532836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1155/2256] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:11:53.534229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc20f69-eaa7-43d7-b9de-82df3a2c3c7b None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:53.543701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc20f69-eaa7-43d7-b9de-82df3a2c3c7b None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:53.549134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:53.549787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.550075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.550359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.551136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:53.553143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:53.566350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:53.650793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1102/2257] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:11:53 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:53.655525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:53.665680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af068463-4248-490f-8070-11e6e80bf310 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:53.669242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:53.720940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:53.721652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.721940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.722213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.722930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:53.724817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:53.803532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1156/2258] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:11:53 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:53.807721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:53.818249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ebf20-016c-4db3-b818-d27fa40f0f78 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:53.823185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:53.823642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.823925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.824201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.824925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:53.827052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:53.838493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1103/2259] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:11:53.843241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:53.853197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3cf87-30ac-4a44-92cf-29b7965567b0 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:53.857740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9617c3-7c08-49e8-90eb-57b6b2ecc05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:53.858385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9617c3-7c08-49e8-90eb-57b6b2ecc05f admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.858667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9617c3-7c08-49e8-90eb-57b6b2ecc05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.858982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9617c3-7c08-49e8-90eb-57b6b2ecc05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.859709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9617c3-7c08-49e8-90eb-57b6b2ecc05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:53.862129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9617c3-7c08-49e8-90eb-57b6b2ecc05f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:53.871865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1157/2260] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:11:53.875862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:53.885765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd476e3-013a-4413-9ba7-d118bd527524 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:53.898800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:53.899762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.900070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.900330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] PATH_INFO: `/v3/projects/b09df9722f134d7eac38d34f29edc809/users/978b8334cf984355bf3f572ccacc8544/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:53.916200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09df9722f134d7eac38d34f29edc809, user_id=978b8334cf984355bf3f572ccacc8544, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:53.918878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:53.974864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1104/2261] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:11:53 2022] PUT /identity/v3/projects/b09df9722f134d7eac38d34f29edc809/users/978b8334cf984355bf3f572ccacc8544/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:11:53.985143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9dbab-1a36-40de-80a8-f86f88a1aff8 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:53.985440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9dbab-1a36-40de-80a8-f86f88a1aff8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:53.985725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9dbab-1a36-40de-80a8-f86f88a1aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:54.012160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f7a9dbab-1a36-40de-80a8-f86f88a1aff8 None None] MFA Rules not processed for user `978b8334cf984355bf3f572ccacc8544`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:54.014008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f7a9dbab-1a36-40de-80a8-f86f88a1aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:54.077989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1158/2262] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:11:54.089187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:54.091052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:54.172417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2e66-8969-4f55-90f3-93745fa0805a admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:54.176355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91552bd-26b1-43cd-ae3e-a88bfb2d9c2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:54.177144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91552bd-26b1-43cd-ae3e-a88bfb2d9c2a service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:54.177502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91552bd-26b1-43cd-ae3e-a88bfb2d9c2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:54.177846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91552bd-26b1-43cd-ae3e-a88bfb2d9c2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:54.187244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91552bd-26b1-43cd-ae3e-a88bfb2d9c2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:54.188669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91552bd-26b1-43cd-ae3e-a88bfb2d9c2a service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:54.197732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1105/2263] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:03.155788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9dbab-1a36-40de-80a8-f86f88a1aff8 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:03.216193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9dbab-1a36-40de-80a8-f86f88a1aff8 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:03.220707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:03.221564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:03.221847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:03.222121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] PATH_INFO: `/v3/users/978b8334cf984355bf3f572ccacc8544` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:03.223322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978b8334cf984355bf3f572ccacc8544)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:03.225267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:03.240931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:03.365788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978b8334cf984355bf3f572ccacc8544'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:03.373254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978b8334cf984355bf3f572ccacc8544'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:03.373915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978b8334cf984355bf3f572ccacc8544'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:03.374526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978b8334cf984355bf3f572ccacc8544'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:03.386871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978b8334cf984355bf3f572ccacc8544'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:03.459068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1159/2264] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:12:03 2022] DELETE /identity/v3/users/978b8334cf984355bf3f572ccacc8544 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:03.463549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:03.464024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:03.464157 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:03.482007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:03.483226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:03.540275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1106/2265] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:03.550295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:03.551719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:03.609117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0c31b-d4d3-42da-bce1-ddda27c39313 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:03.612955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445937e-b349-4294-9a06-2a9f5a0b7298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:03.613624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445937e-b349-4294-9a06-2a9f5a0b7298 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:03.613913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445937e-b349-4294-9a06-2a9f5a0b7298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:03.614196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445937e-b349-4294-9a06-2a9f5a0b7298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:03.624328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445937e-b349-4294-9a06-2a9f5a0b7298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:03.625764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445937e-b349-4294-9a06-2a9f5a0b7298 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:03.636286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1160/2266] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:04.067084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.068498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:04.081245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134813e-ba74-42b6-b863-a5a207e2839e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:04.086195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:04.087130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.092656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.092656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] PATH_INFO: `/v3/projects/b09df9722f134d7eac38d34f29edc809` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.092656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09df9722f134d7eac38d34f29edc809)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:04.092656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:04.202306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:04.210868 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09df9722f134d7eac38d34f29edc809', 'request_id': 'req-0f303e7b-2dc7-4ee4-bb7f-eab617452831'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:04.219703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09df9722f134d7eac38d34f29edc809', 'request_id': 'req-0f303e7b-2dc7-4ee4-bb7f-eab617452831'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:04.225297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09df9722f134d7eac38d34f29edc809', 'request_id': 'req-0f303e7b-2dc7-4ee4-bb7f-eab617452831'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:04.294202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] The token cache is being invalidate because project b09df9722f134d7eac38d34f29edc809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:12:04.294492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:04.295120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0f303e7b-2dc7-4ee4-bb7f-eab617452831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:12:04.296640 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1107/2267] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:12:04 2022] DELETE /identity/v3/projects/b09df9722f134d7eac38d34f29edc809 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:04.301522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baa5a2-f400-4162-a168-f27132b82b8a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.301973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baa5a2-f400-4162-a168-f27132b82b8a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.302082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baa5a2-f400-4162-a168-f27132b82b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.320114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b7baa5a2-f400-4162-a168-f27132b82b8a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:04.321314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b7baa5a2-f400-4162-a168-f27132b82b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:04.381000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1161/2268] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:04.389367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cae84-6780-4de7-9301-6003e1291123 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.389658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cae84-6780-4de7-9301-6003e1291123 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.389939 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cae84-6780-4de7-9301-6003e1291123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.408290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-cc4cae84-6780-4de7-9301-6003e1291123 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:04.409474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-cc4cae84-6780-4de7-9301-6003e1291123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:04.417751 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1108/2269] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:04.421851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baa5a2-f400-4162-a168-f27132b82b8a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.431658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baa5a2-f400-4162-a168-f27132b82b8a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:04.436769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:04.437430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.437710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.437988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.438722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:12:04.439063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:04.440659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:04.452676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1162/2270] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:12:04.456664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cae84-6780-4de7-9301-6003e1291123 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.465710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cae84-6780-4de7-9301-6003e1291123 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:04.470211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:04.470907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.471191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.471466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.472156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:04.474059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:04.541874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1109/2271] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:12:04 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:12:04.545957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.555668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a2a53-68d9-440d-a5ee-0a04292b887e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:04.576341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:04.611315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:04.612008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.612292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.612571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.613259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:04.615206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:04.690203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1163/2272] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:12:04 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:12:04.693556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.704352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931d07-c7fd-4572-9968-b065ae561e95 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:04.708920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:04.713784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.713784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.713784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.713784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:04.713784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:04.722598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1110/2273] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:12:04.726459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.736537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529a70-5e7d-4155-b690-3d8575a3503a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:04.741143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642b7f4-d41a-4a58-a7fc-d68dd7e347d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:04.741800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b7f4-d41a-4a58-a7fc-d68dd7e347d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.742085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b7f4-d41a-4a58-a7fc-d68dd7e347d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.742364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b7f4-d41a-4a58-a7fc-d68dd7e347d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.743124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642b7f4-d41a-4a58-a7fc-d68dd7e347d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:04.744713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642b7f4-d41a-4a58-a7fc-d68dd7e347d8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:04.755490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1164/2274] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:12:04.759434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.769753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7e3a-3bad-4bb1-8cef-635d3ab2ae2f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:04.774735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:04.775639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.775920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.776211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] PATH_INFO: `/v3/projects/476725d6c5c44caebdd8d8e855cc63c6/users/4d6a812133cf437fa3e13f56d1cddd53/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.790713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476725d6c5c44caebdd8d8e855cc63c6, user_id=4d6a812133cf437fa3e13f56d1cddd53, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:04.793364 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:04.853654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1111/2275] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:12:04 2022] PUT /identity/v3/projects/476725d6c5c44caebdd8d8e855cc63c6/users/4d6a812133cf437fa3e13f56d1cddd53/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:04.864440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:04.864734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:04.865108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:04.884442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:04.890247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:04.943019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1165/2276] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:04.952441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:04.954685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:05.012665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93162422-86f9-414a-8eec-5232d91cb679 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:05.016473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:05.017113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:05.017392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:05.017664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:05.026518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:05.027958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:05.037100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1112/2277] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:06.563925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:06.565444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:06.577519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc573480-e9f4-4e21-9f5c-01a5e3238f46 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:06.581103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9bb09-3071-478d-bc21-e458a120706a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:06.581749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9bb09-3071-478d-bc21-e458a120706a service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:06.582035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9bb09-3071-478d-bc21-e458a120706a service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:06.582314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9bb09-3071-478d-bc21-e458a120706a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:06.584085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d7f9bb09-3071-478d-bc21-e458a120706a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:06.668322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9bb09-3071-478d-bc21-e458a120706a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:06.670580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9bb09-3071-478d-bc21-e458a120706a service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:06.687388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1166/2278] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:12:07.892284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:07.902710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cd6bc-fa74-41fc-81cb-53b163909778 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:07.907630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:07.908458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:07.911408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:07.911408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:07.911408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:07.925975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:07.927567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:07.952991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1113/2279] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:12:11.308035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140a1c-d721-4bfd-86f4-67c1b8961c25 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:11.308507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140a1c-d721-4bfd-86f4-67c1b8961c25 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:11.308613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9140a1c-d721-4bfd-86f4-67c1b8961c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:11.338933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a9140a1c-d721-4bfd-86f4-67c1b8961c25 None None] MFA Rules not processed for user `4d6a812133cf437fa3e13f56d1cddd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:11.340231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a9140a1c-d721-4bfd-86f4-67c1b8961c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:11.364272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:11.426879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1167/2280] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:11.431381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:11.451135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7ed14-022c-42c3-9a9f-d9349195d6c1 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:11.458187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:11.459268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:11.459726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:11.460312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:11.461236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:11.463468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:11.588618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1114/2281] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:12:11 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:12:11.594995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9140a1c-d721-4bfd-86f4-67c1b8961c25 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:11.604096 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9140a1c-d721-4bfd-86f4-67c1b8961c25 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:11.685752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:11.686442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:11.686735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:11.687064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:11.687958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:11.689908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:11.756400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1168/2282] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:12:11 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:12:11.761443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:11.772308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333aebc6-fe0b-4e66-a736-209d10888f35 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:11.776992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:11.777632 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:11.777917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:11.778194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:11.778976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:11.780584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:11.792032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1115/2283] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:12:11.796717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:11.806900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a3e1-f5cf-4cd0-8706-af0256303ac9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:11.812402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:11.817115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:11.817115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:11.817115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] PATH_INFO: `/v3/projects/ab7a6f50e1844d37a3b215d4fedf4621/users/fe5899b38e9d40d28ae0ad2b01dd15a5/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:11.829106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7a6f50e1844d37a3b215d4fedf4621, user_id=fe5899b38e9d40d28ae0ad2b01dd15a5, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:11.831858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:11.924735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1169/2284] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:12:11 2022] PUT /identity/v3/projects/ab7a6f50e1844d37a3b215d4fedf4621/users/fe5899b38e9d40d28ae0ad2b01dd15a5/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:11.928592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:11.939781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0808f9-b99d-4fd8-8755-01a7051f6a25 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:11.952986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:11.998172 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384756-6432-452a-8aea-476a3560e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:11.998767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384756-6432-452a-8aea-476a3560e7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:11.999097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384756-6432-452a-8aea-476a3560e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:11.999397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384756-6432-452a-8aea-476a3560e7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:12.000097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf384756-6432-452a-8aea-476a3560e7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:12.001679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf384756-6432-452a-8aea-476a3560e7a8 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:12.011710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1116/2285] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:12:12.017220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:12.028663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4209a-e157-4f92-a131-47cee63e79b0 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:12.033513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:12.034396 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:12.034807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:12.035116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] PATH_INFO: `/v3/projects/ab7a6f50e1844d37a3b215d4fedf4621/users/fe5899b38e9d40d28ae0ad2b01dd15a5/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:12.037100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7a6f50e1844d37a3b215d4fedf4621, user_id=fe5899b38e9d40d28ae0ad2b01dd15a5, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:12.039829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:12.051841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1170/2286] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:12:12 2022] PUT /identity/v3/projects/ab7a6f50e1844d37a3b215d4fedf4621/users/fe5899b38e9d40d28ae0ad2b01dd15a5/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:12:13.634842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2a23-85d7-4513-bd76-35bb7f297462 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:13.635351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2a23-85d7-4513-bd76-35bb7f297462 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:13.636446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2a23-85d7-4513-bd76-35bb7f297462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:13.657800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c7ec2a23-85d7-4513-bd76-35bb7f297462 None None] MFA Rules not processed for user `abcbf501ca754212a16bbfbb901944f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:13.659194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c7ec2a23-85d7-4513-bd76-35bb7f297462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:13.730724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1117/2287] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:18.172258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:18.255847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bf996-b370-4a19-b1f2-fe8295b788e9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:18.264250 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:18.265240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:18.265784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:18.266227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:18.268988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:18.287247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:18.289474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:18.305171 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1171/2288] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:18.312532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea815e-0927-4141-ab07-bcbb2a8ea66f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:18.317637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea815e-0927-4141-ab07-bcbb2a8ea66f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:18.317637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea815e-0927-4141-ab07-bcbb2a8ea66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:18.385508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-24ea815e-0927-4141-ab07-bcbb2a8ea66f None None] MFA Rules not processed for user `fe5899b38e9d40d28ae0ad2b01dd15a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:18.388628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-24ea815e-0927-4141-ab07-bcbb2a8ea66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:18.505378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1118/2289] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:18.518219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:18.520136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:18.546199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:18.593926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbd00f-6fe6-48c4-8e96-312dd9ec0e17 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:18.597878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:18.598949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:18.599344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:18.599526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:18.678867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:18.681006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:18.691868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1172/2290] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:18.980161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:18.983553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:18.983553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:19.014254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:19.015667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:19.063514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:19.090885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1119/2291] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:19.104043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:19.114402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:19.187865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c38f9b-90e2-46d9-8ea9-b22c7d446af8 service glance] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:19.194462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dc8b6-8a7f-4157-8b81-1f4f0151e622 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:19.195160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc8b6-8a7f-4157-8b81-1f4f0151e622 service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:19.195452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc8b6-8a7f-4157-8b81-1f4f0151e622 service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:19.195736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc8b6-8a7f-4157-8b81-1f4f0151e622 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:19.206691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dc8b6-8a7f-4157-8b81-1f4f0151e622 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:19.208341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dc8b6-8a7f-4157-8b81-1f4f0151e622 service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:19.217813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1173/2292] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:12:27.917832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:27.920032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:28.016620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012d139-b30e-4bd0-a914-392ba44dab23 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:28.020856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:28.021533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:28.021820 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:28.022100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:28.023964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:28.111592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:28.112965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:28.126911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1120/2293] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:29.215055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=74 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:29.624513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:29.624855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:29.625146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:29.648588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] MFA Rules not processed for user `8e3e567058964720964d98e76e55e462`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:29.650341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:29.738698 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1174/2294] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:30.370675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:30.370675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda6a5-62cc-4276-9117-4b53a1f76609 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:30.370675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b2739-2e2a-4e54-b303-27969df93699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:30.370675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b2739-2e2a-4e54-b303-27969df93699 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:30.373652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b2739-2e2a-4e54-b303-27969df93699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:30.373652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b2739-2e2a-4e54-b303-27969df93699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:30.373652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ab1b2739-2e2a-4e54-b303-27969df93699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:30.373652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b2739-2e2a-4e54-b303-27969df93699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:30.373652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b2739-2e2a-4e54-b303-27969df93699 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:30.373652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1121/2295] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:30.676715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:30.678355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:30.782163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cc66-38f8-4271-b61f-e38ae7ba50bc None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:30.787878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:30.788840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:30.789364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:30.789872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:30.792844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:30.808306 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:30.810804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:30.823483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1175/2296] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:31.633607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83368ab1-256e-450f-92d3-e203d7b4f6d4 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:31.634956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83368ab1-256e-450f-92d3-e203d7b4f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:31.634956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83368ab1-256e-450f-92d3-e203d7b4f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:31.651087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-83368ab1-256e-450f-92d3-e203d7b4f6d4 None None] MFA Rules not processed for user `4d6a812133cf437fa3e13f56d1cddd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:31.652275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-83368ab1-256e-450f-92d3-e203d7b4f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:31.666408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1122/2297] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:12:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:34.674867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:34.684666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102e9eb-1788-468b-aceb-9e03a390f9dc service placement] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:34.688499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:34.689146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:34.689443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:34.689724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:34.691520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:34.701752 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:34.703252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:34.711147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1176/2298] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:37.101711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:37.101711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:37.101711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:37.127296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:37.129303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:37.152313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1123/2299] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:12:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:37.195904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:37.210724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329158-ff96-4d7c-809e-57503c3dfd06 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:37.219918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:37.220731 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:37.221022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:37.221644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:37.234184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:37.235973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:37.261298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1177/2300] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:12:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:12:37.384782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:37.386232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:37.607166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178287c-c8c9-49d9-b7dd-c4c46df9a7c8 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:37.638026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:37.642301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:37.644734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:37.645033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:37.650908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:37.687718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:37.775824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:37.777555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:37.789126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1124/2301] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:39.736578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:39.738794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:39.770427 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868a18-d34d-4710-ab30-ff586adc1737 service swift] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:39.785758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:39.786723 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:39.787139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:39.787615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:39.792390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:39.811699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:39.814800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:39.828728 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1178/2302] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:47.784152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=21 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:49.822397 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=75 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:55.250213 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:55.261995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d71c-0725-4ee4-8221-3157c41599de service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:55.272275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:55.274108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:55.274108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:55.274108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:55.275421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:55.289038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:55.290789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:55.301936 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1125/2303] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:59.530458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:59.540118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d310c-a81f-4c45-aa11-c32fc0d53666 service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:59.544537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:59.548295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:59.548295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:59.548295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:59.548295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:59.611671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:59.613136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:59.623734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1179/2304] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:59.861480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:59.874118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42b872-7d7d-41fc-aff4-4d9149b5ab12 service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:59.880318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:59.881275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:59.881910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:59.882429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:59.884513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:59.901616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:59.904122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:59.918200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1126/2305] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:03.928395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:03.930753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:03.946744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a102a10-0ebe-48bf-a26e-b2411351ce37 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:03.952175 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:03.953072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:03.953333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:03.953610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] PATH_INFO: `/v3/users/71ac6423996b4e5d906de9ff6986fb03` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:03.954802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ac6423996b4e5d906de9ff6986fb03)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:03.956909 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:04.132331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ac6423996b4e5d906de9ff6986fb03'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.139357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ac6423996b4e5d906de9ff6986fb03'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.140055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ac6423996b4e5d906de9ff6986fb03'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.140662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ac6423996b4e5d906de9ff6986fb03'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.152737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b5b17a50-f7f9-4d71-b983-5976813591df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ac6423996b4e5d906de9ff6986fb03'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.249862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1180/2306] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:03 2022] DELETE /identity/v3/users/71ac6423996b4e5d906de9ff6986fb03 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:04.491071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:04.502619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8eeec-0d4c-4f4f-9c8c-996c78013d3a service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:04.567826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:04.568711 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:04.568994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:04.569301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] PATH_INFO: `/v3/projects/aa1c1626dad34ae9a2216e46ffae4003` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:04.570560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1c1626dad34ae9a2216e46ffae4003)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:04.572533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:04.688602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1c1626dad34ae9a2216e46ffae4003', 'request_id': 'req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.696472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1c1626dad34ae9a2216e46ffae4003', 'request_id': 'req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.702997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1c1626dad34ae9a2216e46ffae4003', 'request_id': 'req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.757150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] The token cache is being invalidate because project aa1c1626dad34ae9a2216e46ffae4003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:04.760305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.760305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-27ed6c68-8c98-4c7d-9b6f-2a75d45103a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:04.760305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1127/2307] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:04 2022] DELETE /identity/v3/projects/aa1c1626dad34ae9a2216e46ffae4003 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:04.765035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae1ae1-9007-41c3-bd37-39d8db353a30 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:04.765327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae1ae1-9007-41c3-bd37-39d8db353a30 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:04.765607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae1ae1-9007-41c3-bd37-39d8db353a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:04.783991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5aae1ae1-9007-41c3-bd37-39d8db353a30 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:04.785198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5aae1ae1-9007-41c3-bd37-39d8db353a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:04.842314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1181/2308] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:04.849913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3529f-f99d-4c74-a47c-2353b3d1bae3 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:04.850210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3529f-f99d-4c74-a47c-2353b3d1bae3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:04.850497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3529f-f99d-4c74-a47c-2353b3d1bae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:04.868665 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-96c3529f-f99d-4c74-a47c-2353b3d1bae3 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:04.869874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-96c3529f-f99d-4c74-a47c-2353b3d1bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:04.877802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1128/2309] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:04.881854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae1ae1-9007-41c3-bd37-39d8db353a30 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:04.892217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae1ae1-9007-41c3-bd37-39d8db353a30 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:04.896770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:04.897419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:04.897700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:04.897976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:04.898712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:13:04.899048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:04.900638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:04.902105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:04.912766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1182/2310] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:13:04.917712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3529f-f99d-4c74-a47c-2353b3d1bae3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:04.926995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3529f-f99d-4c74-a47c-2353b3d1bae3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:04.931666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:04.932359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:04.932646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:04.932925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:04.933626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:04.935563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:05.022249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1129/2311] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:04 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:13:05.025967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:05.036636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2e1cf-ec66-4cf6-8e24-21197f9f1db3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:05.092613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:05.093296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:05.093582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:05.093858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:05.094532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:05.096475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:05.208523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1183/2312] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:05 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:05.212817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:05.223337 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264a38-8098-4bcf-b630-029444da7f48 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:05.228472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:05.229117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:05.229401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:05.229672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:05.230393 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:05.232106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:05.242396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1130/2313] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:05.246341 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:05.256671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135386-34f3-45a6-b503-4ba3bb14b6b7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:05.261244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e2e42-8129-4840-b4c6-2aafabe0ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:05.261892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e2e42-8129-4840-b4c6-2aafabe0ae0c admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:05.262173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e2e42-8129-4840-b4c6-2aafabe0ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:05.262449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e2e42-8129-4840-b4c6-2aafabe0ae0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:05.263848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e2e42-8129-4840-b4c6-2aafabe0ae0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:05.265434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e2e42-8129-4840-b4c6-2aafabe0ae0c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:05.278953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1184/2314] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:05.279912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:05.290083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c3f94-3194-46dd-98ff-15bdc1fcb162 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:05.294724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:05.295624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:05.295910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:05.296188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] PATH_INFO: `/v3/projects/6b8d8a9dd61744f9a89157bda059b57e/users/2b7284d0bcf343e4a8c53db33e5cecc8/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:05.311467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8d8a9dd61744f9a89157bda059b57e, user_id=2b7284d0bcf343e4a8c53db33e5cecc8, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:05.314272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:05.382054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:05.386701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1131/2315] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:05 2022] PUT /identity/v3/projects/6b8d8a9dd61744f9a89157bda059b57e/users/2b7284d0bcf343e4a8c53db33e5cecc8/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:05.402612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0d1c8-0735-49be-aaa2-d35745581f22 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:05.402952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0d1c8-0735-49be-aaa2-d35745581f22 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:05.403224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0d1c8-0735-49be-aaa2-d35745581f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:05.428954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-1bd0d1c8-0735-49be-aaa2-d35745581f22 None None] MFA Rules not processed for user `2b7284d0bcf343e4a8c53db33e5cecc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:05.430182 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-1bd0d1c8-0735-49be-aaa2-d35745581f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:05.498856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1185/2316] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:05.509638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:05.513412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:05.571305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d5a94-1f04-4018-a0b9-4242fac86687 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:05.575183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:05.575832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:05.576114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:05.576387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:05.587804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:05.597832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:05.600200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1132/2317] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:12.868994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1314-f3a4-4f2b-bca1-1be2d8cc400e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:12.869554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1314-f3a4-4f2b-bca1-1be2d8cc400e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:12.869687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1314-f3a4-4f2b-bca1-1be2d8cc400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:12.887907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a71d1314-f3a4-4f2b-bca1-1be2d8cc400e None None] MFA Rules not processed for user `0673a8903f56430f86f87b9447668300`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:12.889605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a71d1314-f3a4-4f2b-bca1-1be2d8cc400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:12.946095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1186/2318] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:13.259106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:13.260504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:13.316208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee44e-818c-44e9-ac8a-fc4aa0ceb312 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:13.319782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:13.320430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:13.320715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:13.320993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:13.322777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:13.332289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:13.333696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:13.341722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1133/2319] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:14.574008 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1314-f3a4-4f2b-bca1-1be2d8cc400e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:14.584216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1314-f3a4-4f2b-bca1-1be2d8cc400e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:14.587808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63cc5c-be1d-400f-859b-eb2e2a0d84f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:14.588457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63cc5c-be1d-400f-859b-eb2e2a0d84f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:14.588737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63cc5c-be1d-400f-859b-eb2e2a0d84f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:14.589016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63cc5c-be1d-400f-859b-eb2e2a0d84f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:14.590905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4e63cc5c-be1d-400f-859b-eb2e2a0d84f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:14.596692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:14.655283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63cc5c-be1d-400f-859b-eb2e2a0d84f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:14.656821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63cc5c-be1d-400f-859b-eb2e2a0d84f3 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:14.666301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1187/2320] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:15.261253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:15.336592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefded39-a1ad-4475-9e78-03dc16614e26 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:15.341937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:15.342917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:15.343120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:15.343447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] PATH_INFO: `/v3/users/2b7284d0bcf343e4a8c53db33e5cecc8` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:15.344654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7284d0bcf343e4a8c53db33e5cecc8)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:15.346616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:15.522478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7284d0bcf343e4a8c53db33e5cecc8'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:15.524284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:15.658119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7284d0bcf343e4a8c53db33e5cecc8'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:15.658119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7284d0bcf343e4a8c53db33e5cecc8'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:15.658119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7284d0bcf343e4a8c53db33e5cecc8'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:15.658119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7284d0bcf343e4a8c53db33e5cecc8'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:15.677067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1134/2321] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:15 2022] DELETE /identity/v3/users/2b7284d0bcf343e4a8c53db33e5cecc8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:13:15.709872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:15.710574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:15.710574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:15.729965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:15.731229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:15.804368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1188/2322] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:15.815222 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:15.816671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:15.874211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc2e51-6f2c-4714-b0bc-a7649d0d8594 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:15.877865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ebfb-c3e8-4918-bd13-ad347e727e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:15.878513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ebfb-c3e8-4918-bd13-ad347e727e6b service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:15.878851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ebfb-c3e8-4918-bd13-ad347e727e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:15.883431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ebfb-c3e8-4918-bd13-ad347e727e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:15.889419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ebfb-c3e8-4918-bd13-ad347e727e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:15.890884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ebfb-c3e8-4918-bd13-ad347e727e6b service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:15.901029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1135/2323] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:13:16.634357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:16.636237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:16.651038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39526bc-cee6-405c-a3a9-8b2ac5ce158f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:16.657168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:16.658457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:16.658747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:16.659243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] PATH_INFO: `/v3/projects/6b8d8a9dd61744f9a89157bda059b57e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:16.660542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8d8a9dd61744f9a89157bda059b57e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:16.663112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:16.821484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8d8a9dd61744f9a89157bda059b57e', 'request_id': 'req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:16.829897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8d8a9dd61744f9a89157bda059b57e', 'request_id': 'req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:16.836903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8d8a9dd61744f9a89157bda059b57e', 'request_id': 'req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:16.919083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] The token cache is being invalidate because project 6b8d8a9dd61744f9a89157bda059b57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:16.919547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:16.920298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d01dbbae-b19e-4a9c-9f8b-d43e42a089d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:16.922288 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1189/2324] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:16 2022] DELETE /identity/v3/projects/6b8d8a9dd61744f9a89157bda059b57e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:16.927470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbf80d-7094-4dde-8e56-10498238c337 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:16.928909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbf80d-7094-4dde-8e56-10498238c337 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:16.928909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbf80d-7094-4dde-8e56-10498238c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:16.948634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1fbbf80d-7094-4dde-8e56-10498238c337 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:16.950046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1fbbf80d-7094-4dde-8e56-10498238c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:17.040889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1136/2325] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:17.043635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07024093-bb82-486c-add7-28324afe3cf4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.044057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07024093-bb82-486c-add7-28324afe3cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.044443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07024093-bb82-486c-add7-28324afe3cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.070515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-07024093-bb82-486c-add7-28324afe3cf4 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:17.072085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-07024093-bb82-486c-add7-28324afe3cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:17.081625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1190/2326] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:17.086346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbf80d-7094-4dde-8e56-10498238c337 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:17.098308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbf80d-7094-4dde-8e56-10498238c337 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:17.103912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:17.104597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.104967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.105248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.106006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:13:17.107191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:17.108205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:17.126621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1137/2327] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:13:17.127852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07024093-bb82-486c-add7-28324afe3cf4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:17.137839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07024093-bb82-486c-add7-28324afe3cf4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:17.144013 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:17.144927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.145284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.145791 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.147339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:17.150908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:17.174551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:17.275248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1191/2328] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:17 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:17.279824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:17.290642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc21d1-ec07-4896-b8bb-7f5788329f37 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:17.365442 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:17.372452 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:17.374241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.374661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.375071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.379880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:17.379880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:17.502366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1138/2329] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:17 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:17.506590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:17.517635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326446e-e515-4c33-9e66-d377c23e29ab admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:17.522318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:17.523149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.523438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.523717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.524446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:17.526106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:17.536940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1192/2330] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:17.541069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:17.553088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67210f7-9fa1-4b7b-b14e-f42bc8940157 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:17.558121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56fe9e-c37b-4fd8-911a-81c072b9dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:17.558790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56fe9e-c37b-4fd8-911a-81c072b9dad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.559110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56fe9e-c37b-4fd8-911a-81c072b9dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.559395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56fe9e-c37b-4fd8-911a-81c072b9dad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.560136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56fe9e-c37b-4fd8-911a-81c072b9dad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:17.562593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56fe9e-c37b-4fd8-911a-81c072b9dad5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:17.586391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1139/2331] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:13:17.591390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:17.620907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b00e-52ee-4d83-9962-649ed595f3f6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:17.629525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:17.630643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.631140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.631972 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] PATH_INFO: `/v3/projects/be94a282f39b493fab6fdf8e58a38b29/users/1bd7723efdd64c6a960644e809b7bb90/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.660323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be94a282f39b493fab6fdf8e58a38b29, user_id=1bd7723efdd64c6a960644e809b7bb90, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:17.663051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:17.822088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1193/2332] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:17 2022] PUT /identity/v3/projects/be94a282f39b493fab6fdf8e58a38b29/users/1bd7723efdd64c6a960644e809b7bb90/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:17.827232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10eae-1f90-4243-b23d-eb451dfdf8fc None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:17.827551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10eae-1f90-4243-b23d-eb451dfdf8fc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:17.827841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10eae-1f90-4243-b23d-eb451dfdf8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:17.849349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f8f10eae-1f90-4243-b23d-eb451dfdf8fc None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:17.850673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f8f10eae-1f90-4243-b23d-eb451dfdf8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:17.952844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1140/2333] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:17.961570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:17.964864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:18.049682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bb7d2-0829-42c5-8b3c-0c70a004f757 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:18.056051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:18.056717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:18.056998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:18.057484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:18.067487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:18.068925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:18.080029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1194/2334] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:19.631558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5650-2dc7-4f6f-960a-905c5a960602 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:19.632115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5650-2dc7-4f6f-960a-905c5a960602 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:19.632499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5650-2dc7-4f6f-960a-905c5a960602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:19.682303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9a3b5650-2dc7-4f6f-960a-905c5a960602 None None] MFA Rules not processed for user `1bd7723efdd64c6a960644e809b7bb90`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:19.683743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9a3b5650-2dc7-4f6f-960a-905c5a960602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:19.781257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1141/2335] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:19.782460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:19.799912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c69668-7e96-4a70-bebe-92cadc48d8ef service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:19.805637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:19.806265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:19.806562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:19.806872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:19.807604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:19.809878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:19.904913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b5650-2dc7-4f6f-960a-905c5a960602 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:19.915569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1195/2336] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:19 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:19.919733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b5650-2dc7-4f6f-960a-905c5a960602 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:19.988824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:19.989622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:19.989981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:19.990335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:19.991194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:19.993368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:20.002857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:20.110929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1142/2337] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:19 2022] POST /identity/v3/users => generated 308 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:20.113221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:20.124553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0593d-03fc-4622-80ae-946934bb3ff6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:20.129487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:20.130156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:20.130444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:20.130790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:20.131557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:20.133158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:20.144491 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1196/2338] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:20.148795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:20.159195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ca14-b61a-415e-a3f6-c8f570ddee20 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:20.163875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:20.164781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:20.165065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:20.165345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] PATH_INFO: `/v3/projects/34c6b39443994de58a9d7df71c57e3c1/users/b056a4c635ed4ae782fd9d5e570da6ba/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:20.180185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c6b39443994de58a9d7df71c57e3c1, user_id=b056a4c635ed4ae782fd9d5e570da6ba, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:20.189977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:20.272579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1143/2339] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:20 2022] PUT /identity/v3/projects/34c6b39443994de58a9d7df71c57e3c1/users/b056a4c635ed4ae782fd9d5e570da6ba/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:20.276504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:20.286800 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3f70-7a2c-46f5-adbd-308f05f30d80 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:20.366792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c277e-1a81-4767-8b7b-c2d9556377f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:20.373411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c277e-1a81-4767-8b7b-c2d9556377f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:20.373411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c277e-1a81-4767-8b7b-c2d9556377f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:20.373411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c277e-1a81-4767-8b7b-c2d9556377f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:20.373411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c277e-1a81-4767-8b7b-c2d9556377f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:20.373411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c277e-1a81-4767-8b7b-c2d9556377f0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:20.385939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1197/2340] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:20.387218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:20.398571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5ef13-b408-4f05-8c78-e71ca66cf587 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:20.403932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:20.404850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:20.405134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:20.405408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] PATH_INFO: `/v3/projects/34c6b39443994de58a9d7df71c57e3c1/users/b056a4c635ed4ae782fd9d5e570da6ba/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:20.407409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c6b39443994de58a9d7df71c57e3c1, user_id=b056a4c635ed4ae782fd9d5e570da6ba, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:20.410030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:20.426797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1144/2341] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:20 2022] PUT /identity/v3/projects/34c6b39443994de58a9d7df71c57e3c1/users/b056a4c635ed4ae782fd9d5e570da6ba/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:22.301754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8847-b705-49e9-bda3-d7771aab78d5 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:22.302354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8847-b705-49e9-bda3-d7771aab78d5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:22.302650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8847-b705-49e9-bda3-d7771aab78d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:22.376551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6b0d8847-b705-49e9-bda3-d7771aab78d5 None None] MFA Rules not processed for user `b056a4c635ed4ae782fd9d5e570da6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:22.376551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6b0d8847-b705-49e9-bda3-d7771aab78d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:22.444079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:22.556271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1198/2342] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:23.260177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:23.266571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:23.414906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e0c8c-b68b-48cc-9394-050344abf286 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:23.421541 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:23.422283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:23.422797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:23.423169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:23.425325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:23.451174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:23.453881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:23.475435 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1145/2343] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:24.186094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d8847-b705-49e9-bda3-d7771aab78d5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:24.198238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d8847-b705-49e9-bda3-d7771aab78d5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:24.205054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:24.205712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:24.206003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:24.206286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:24.208208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:24.222037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:24.223703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:24.235109 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1199/2344] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:24.298678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:24.377649 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030452e0-42ff-4a48-b9b0-4137292e79d7 service placement] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:24.382525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:24.388881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:24.388881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:24.388881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] PATH_INFO: `/v3/users/1bd7723efdd64c6a960644e809b7bb90` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:24.388881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd7723efdd64c6a960644e809b7bb90)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:24.388881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:24.599405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd7723efdd64c6a960644e809b7bb90'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:24.601064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:24.681263 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd7723efdd64c6a960644e809b7bb90'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:24.694534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd7723efdd64c6a960644e809b7bb90'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:24.695262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd7723efdd64c6a960644e809b7bb90'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:24.695879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd7723efdd64c6a960644e809b7bb90'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:24.716072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1146/2345] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:24 2022] DELETE /identity/v3/users/1bd7723efdd64c6a960644e809b7bb90 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:24.971258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:24.985052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca270c-1d2e-47ab-9a28-2d42cecd9ed0 service placement] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:25.052436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:25.053345 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:25.053631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:25.053910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] PATH_INFO: `/v3/projects/be94a282f39b493fab6fdf8e58a38b29` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:25.055327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be94a282f39b493fab6fdf8e58a38b29)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:25.057273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:25.201369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be94a282f39b493fab6fdf8e58a38b29', 'request_id': 'req-10da22e1-7971-40b3-a993-2395344470e9'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.209794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be94a282f39b493fab6fdf8e58a38b29', 'request_id': 'req-10da22e1-7971-40b3-a993-2395344470e9'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.216620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be94a282f39b493fab6fdf8e58a38b29', 'request_id': 'req-10da22e1-7971-40b3-a993-2395344470e9'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.297913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] The token cache is being invalidate because project be94a282f39b493fab6fdf8e58a38b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:25.297913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.297913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.297913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1200/2346] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:24 2022] DELETE /identity/v3/projects/be94a282f39b493fab6fdf8e58a38b29 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:25.298780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:25.300514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:25.315878 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe78f8e-36f3-4b11-88d7-643b2d6a31a9 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:25.374628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:25.375543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:25.375824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:25.376101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] PATH_INFO: `/v3/users/b056a4c635ed4ae782fd9d5e570da6ba` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:25.377269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b056a4c635ed4ae782fd9d5e570da6ba)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:25.379218 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:25.576261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b056a4c635ed4ae782fd9d5e570da6ba'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.636701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b056a4c635ed4ae782fd9d5e570da6ba'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.644277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b056a4c635ed4ae782fd9d5e570da6ba'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.644929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b056a4c635ed4ae782fd9d5e570da6ba'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.645549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a06a7c7-2b3f-4046-b748-8e863bc0303b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b056a4c635ed4ae782fd9d5e570da6ba'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:25.663363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1147/2347] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:25 2022] DELETE /identity/v3/users/b056a4c635ed4ae782fd9d5e570da6ba => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:13:26.010028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:26.011858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:26.036900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da22e1-7971-40b3-a993-2395344470e9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:26.068060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:26.104614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:26.105504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.105793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.106074 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] PATH_INFO: `/v3/projects/34c6b39443994de58a9d7df71c57e3c1` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.107380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c6b39443994de58a9d7df71c57e3c1)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:26.109355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:26.238597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c6b39443994de58a9d7df71c57e3c1', 'request_id': 'req-c5c4dbf7-c9e0-491c-bb30-0b2827130589'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:26.244943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c6b39443994de58a9d7df71c57e3c1', 'request_id': 'req-c5c4dbf7-c9e0-491c-bb30-0b2827130589'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:26.251294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c6b39443994de58a9d7df71c57e3c1', 'request_id': 'req-c5c4dbf7-c9e0-491c-bb30-0b2827130589'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:26.329402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] The token cache is being invalidate because project 34c6b39443994de58a9d7df71c57e3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:26.329794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:26.330519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c5c4dbf7-c9e0-491c-bb30-0b2827130589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:26.332258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1201/2348] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:26 2022] DELETE /identity/v3/projects/34c6b39443994de58a9d7df71c57e3c1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:26.337149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04fca5-80be-4653-8369-164f92618a31 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.337629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04fca5-80be-4653-8369-164f92618a31 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.337725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04fca5-80be-4653-8369-164f92618a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.357587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fd04fca5-80be-4653-8369-164f92618a31 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:26.359094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fd04fca5-80be-4653-8369-164f92618a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:26.404227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:26.423469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1148/2349] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:26.431383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19532cf6-dd87-405c-9851-a6d54a26c52e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.431677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19532cf6-dd87-405c-9851-a6d54a26c52e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.431960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19532cf6-dd87-405c-9851-a6d54a26c52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.451659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-19532cf6-dd87-405c-9851-a6d54a26c52e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:26.452789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-19532cf6-dd87-405c-9851-a6d54a26c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:26.460748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1202/2350] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:26.469795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04fca5-80be-4653-8369-164f92618a31 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:26.479855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04fca5-80be-4653-8369-164f92618a31 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:26.484996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:26.485678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.485965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.486246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.487036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:13:26.487347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:26.488975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:26.501110 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1149/2351] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:13:26.509252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19532cf6-dd87-405c-9851-a6d54a26c52e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:26.518768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19532cf6-dd87-405c-9851-a6d54a26c52e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:26.523579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:26.524239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.524529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.524812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.525534 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:26.527615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:26.616811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1203/2352] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:26 2022] POST /identity/v3/projects => generated 357 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:26.620875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:26.631282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed374c-4e10-4f12-9ee9-f4e4f2b100d7 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:26.688686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:26.689385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.689673 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.689993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.690733 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:26.692723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:26.826849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1150/2353] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:26 2022] POST /identity/v3/users => generated 279 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:26.830866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:26.841678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3b28-2205-4649-8b29-dc5164f3a00d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:26.846368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:26.847054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.847342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.847633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.848366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:26.849948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:26.860764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1204/2354] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:26.864683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:26.875398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59716681-0aae-436e-9e90-2ff2175a06c8 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:26.879984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c3b3e-f845-4efb-80a3-2c0515476e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:26.880636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c3b3e-f845-4efb-80a3-2c0515476e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.880926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c3b3e-f845-4efb-80a3-2c0515476e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.881207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c3b3e-f845-4efb-80a3-2c0515476e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.881937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c3b3e-f845-4efb-80a3-2c0515476e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:26.883727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c3b3e-f845-4efb-80a3-2c0515476e37 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:26.893814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1151/2355] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:26.897683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:26.907893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c22e-9d82-46ab-bab1-074bba4fc162 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:26.912261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:26.913127 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:26.913410 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:26.913685 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] PATH_INFO: `/v3/projects/0d2cf0bb930b4fb0895814e508dba986/users/9d54e757d6b84dd78a6a9da3786ca575/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:26.928586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2cf0bb930b4fb0895814e508dba986, user_id=9d54e757d6b84dd78a6a9da3786ca575, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:26.931241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.015436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1205/2356] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:26 2022] PUT /identity/v3/projects/0d2cf0bb930b4fb0895814e508dba986/users/9d54e757d6b84dd78a6a9da3786ca575/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:27.025428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430622a5-40e0-42e6-8078-be79c0fb3426 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.025757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430622a5-40e0-42e6-8078-be79c0fb3426 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.027438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430622a5-40e0-42e6-8078-be79c0fb3426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.053158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-430622a5-40e0-42e6-8078-be79c0fb3426 None None] MFA Rules not processed for user `9d54e757d6b84dd78a6a9da3786ca575`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:27.054410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-430622a5-40e0-42e6-8078-be79c0fb3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:27.120892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1152/2357] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:27 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:27.126162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:27.182032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:27.197123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d985e4-84f7-4231-9000-facb74514edd admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:27.204966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:27.204966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.204966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.204966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.205392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:27.205809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.314886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1206/2358] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:27 2022] POST /identity/v3/projects => generated 355 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:27.316966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430622a5-40e0-42e6-8078-be79c0fb3426 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:27.333757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430622a5-40e0-42e6-8078-be79c0fb3426 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:27.392543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:27.411743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:27.412460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.412840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.413015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.413719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:27.415677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.521707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1153/2359] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:27 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:27.523144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:27.534126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f9eb-45ae-43df-bfb9-399fcf8113a4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:27.538897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:27.539559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.539848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.540129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.540888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:27.542476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.553084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1207/2360] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:27.557488 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:27.567886 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc786101-fc3f-45fb-8408-e3d60532b6fd admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:27.572579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:27.574070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.574362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.574642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] PATH_INFO: `/v3/projects/24e21d2f36d74265b7d93af142622326/users/f0561f44f04f4569927ecb34eccab202/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.590289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e21d2f36d74265b7d93af142622326, user_id=f0561f44f04f4569927ecb34eccab202, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:27.593585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.671600 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1154/2361] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:27 2022] PUT /identity/v3/projects/24e21d2f36d74265b7d93af142622326/users/f0561f44f04f4569927ecb34eccab202/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:27.675543 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:27.686243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285dc50-91b3-48ae-9928-bb78a30b189d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:27.742769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce537-6194-4c16-a9a2-3db0c15c3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:27.743466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce537-6194-4c16-a9a2-3db0c15c3946 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.743847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce537-6194-4c16-a9a2-3db0c15c3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.744022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce537-6194-4c16-a9a2-3db0c15c3946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.744748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce537-6194-4c16-a9a2-3db0c15c3946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:27.746367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce537-6194-4c16-a9a2-3db0c15c3946 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.756916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1208/2362] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:27.760979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:27.772907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac605-cd88-48e2-a55e-bb5405c88670 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:27.777548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:27.778414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.778692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.779035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] PATH_INFO: `/v3/projects/24e21d2f36d74265b7d93af142622326/users/f0561f44f04f4569927ecb34eccab202/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.780998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e21d2f36d74265b7d93af142622326, user_id=f0561f44f04f4569927ecb34eccab202, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:27.783677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.794759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1155/2363] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:27 2022] PUT /identity/v3/projects/24e21d2f36d74265b7d93af142622326/users/f0561f44f04f4569927ecb34eccab202/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:27.805677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d308-944b-47ba-add3-71ad1882c192 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.805970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d308-944b-47ba-add3-71ad1882c192 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.806254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d308-944b-47ba-add3-71ad1882c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.834995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-cb04d308-944b-47ba-add3-71ad1882c192 None None] MFA Rules not processed for user `f0561f44f04f4569927ecb34eccab202`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:27.836243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cb04d308-944b-47ba-add3-71ad1882c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:27.902712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1209/2364] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:27 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:27.913911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:27.915625 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:27.973154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd349e0-4fb4-4e8b-baf1-019f8bf1de1f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:27.976822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:27.977461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:27.977743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:27.978018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:27.988002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:27.989480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:27.999490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1156/2365] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:27 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:28.227180 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04d308-944b-47ba-add3-71ad1882c192 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:28.238037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04d308-944b-47ba-add3-71ad1882c192 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:28.241598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:28.242292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:28.242579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:28.242875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:28.284954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:28.302314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:28.303795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:28.314254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1210/2366] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:28 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:37.994615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:38.329238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=9 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:43.429996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:43.431456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:43.503216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12daefc-0cfb-49f3-856c-c1c053bbf9c9 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:43.508881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d5622-739c-4874-b0b2-00b8dacb2dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:43.509527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d5622-739c-4874-b0b2-00b8dacb2dab service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:43.509806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d5622-739c-4874-b0b2-00b8dacb2dab service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:43.510081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d5622-739c-4874-b0b2-00b8dacb2dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:43.511875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-691d5622-739c-4874-b0b2-00b8dacb2dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:43.568526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d5622-739c-4874-b0b2-00b8dacb2dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:43.570092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d5622-739c-4874-b0b2-00b8dacb2dab service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:43.579146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1157/2367] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:47.218892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:47.289912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6ef2f-c5a3-4d72-8988-29b86523c5c7 service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:47.295436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:47.296340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:47.296625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:47.296924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] PATH_INFO: `/v3/users/9d54e757d6b84dd78a6a9da3786ca575` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:47.298142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d54e757d6b84dd78a6a9da3786ca575)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:47.300145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:47.492301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d54e757d6b84dd78a6a9da3786ca575'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:47.499796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d54e757d6b84dd78a6a9da3786ca575'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:47.500450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d54e757d6b84dd78a6a9da3786ca575'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:47.501052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d54e757d6b84dd78a6a9da3786ca575'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:47.512630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d54e757d6b84dd78a6a9da3786ca575'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:47.585733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1211/2368] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:47 2022] DELETE /identity/v3/users/9d54e757d6b84dd78a6a9da3786ca575 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:47.590327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:47.591266 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:47.591565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:47.609497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:47.610718 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:47.692217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1158/2369] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:47.701400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:47.703025 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:47.766913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8be45-1e1d-43f3-b66f-717161780cf8 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:47.770527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:47.771205 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:47.771485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:47.771759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:47.781502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:47.782991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:47.792900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1212/2370] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:48.302261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:48.303883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:48.315794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b94b-fe3d-4f53-a178-b1ef0e0b4840 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:48.320596 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:48.321527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:48.321854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:48.322126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] PATH_INFO: `/v3/projects/0d2cf0bb930b4fb0895814e508dba986` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:48.323351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2cf0bb930b4fb0895814e508dba986)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:48.325758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:48.413509 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:48.425128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2cf0bb930b4fb0895814e508dba986', 'request_id': 'req-9191ccd9-316e-4831-a689-d9641531ec65'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.431284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2cf0bb930b4fb0895814e508dba986', 'request_id': 'req-9191ccd9-316e-4831-a689-d9641531ec65'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.436870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2cf0bb930b4fb0895814e508dba986', 'request_id': 'req-9191ccd9-316e-4831-a689-d9641531ec65'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.534682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] The token cache is being invalidate because project 0d2cf0bb930b4fb0895814e508dba986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:48.534952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.535587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.537144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1159/2371] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:48 2022] DELETE /identity/v3/projects/0d2cf0bb930b4fb0895814e508dba986 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:48.541125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:48.550920 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae206d-f622-4a3d-9807-32f06cacac1c service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:48.568852 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:48.607138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:48.608051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:48.608338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:48.608618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] PATH_INFO: `/v3/users/f0561f44f04f4569927ecb34eccab202` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:48.609812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0561f44f04f4569927ecb34eccab202)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:48.611764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:48.828217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0561f44f04f4569927ecb34eccab202'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.834779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0561f44f04f4569927ecb34eccab202'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.835446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0561f44f04f4569927ecb34eccab202'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.836084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0561f44f04f4569927ecb34eccab202'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.848465 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0d0e3ee2-6df2-4bd1-be1c-2ccfb84d914e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0561f44f04f4569927ecb34eccab202'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:48.946699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1213/2372] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:48 2022] DELETE /identity/v3/users/f0561f44f04f4569927ecb34eccab202 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:13:49.330491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:49.332075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:49.345333 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191ccd9-316e-4831-a689-d9641531ec65 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:49.414084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:49.415206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:49.415536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:49.415881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] PATH_INFO: `/v3/projects/24e21d2f36d74265b7d93af142622326` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:49.417093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e21d2f36d74265b7d93af142622326)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:49.419108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:49.563002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e21d2f36d74265b7d93af142622326', 'request_id': 'req-6a137d65-8a12-49c2-b143-4441d5b6963c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:49.569135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e21d2f36d74265b7d93af142622326', 'request_id': 'req-6a137d65-8a12-49c2-b143-4441d5b6963c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:49.574531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e21d2f36d74265b7d93af142622326', 'request_id': 'req-6a137d65-8a12-49c2-b143-4441d5b6963c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:49.666268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] The token cache is being invalidate because project 24e21d2f36d74265b7d93af142622326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:49.666471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:49.667124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6a137d65-8a12-49c2-b143-4441d5b6963c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:49.668700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1160/2373] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:49 2022] DELETE /identity/v3/projects/24e21d2f36d74265b7d93af142622326 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:49.674232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2596f90-4d7b-43b2-89d0-70521f3eaa25 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:49.674734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2596f90-4d7b-43b2-89d0-70521f3eaa25 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:49.674872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2596f90-4d7b-43b2-89d0-70521f3eaa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:49.693014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c2596f90-4d7b-43b2-89d0-70521f3eaa25 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:49.694237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c2596f90-4d7b-43b2-89d0-70521f3eaa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:49.764026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1214/2374] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:49.772196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff787e82-524c-4343-b5ed-60a12621d171 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:49.776893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff787e82-524c-4343-b5ed-60a12621d171 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:49.776893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff787e82-524c-4343-b5ed-60a12621d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:49.792790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-ff787e82-524c-4343-b5ed-60a12621d171 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:49.794117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ff787e82-524c-4343-b5ed-60a12621d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:49.802044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1161/2375] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:49.806280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2596f90-4d7b-43b2-89d0-70521f3eaa25 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:49.815992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2596f90-4d7b-43b2-89d0-70521f3eaa25 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:49.820574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:49.821226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:49.821514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:49.821796 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:49.822528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:13:49.822867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:49.824471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:49.836351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1215/2376] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:13:49.840546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff787e82-524c-4343-b5ed-60a12621d171 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:49.850350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff787e82-524c-4343-b5ed-60a12621d171 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:49.855327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:49.855963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:49.856243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:49.856568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:49.857289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:49.859220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:49.958927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1162/2377] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:49 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:49.963083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:49.975474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7074-a05d-44cb-aaab-94107c77bac0 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.002038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:50.035015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.035727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.036011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.036284 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.036967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.038985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.146303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1216/2378] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:49 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:13:50.147545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.158142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd00b7a-13c6-46ea-adbf-6665621ae933 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.162797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.163514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.163826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.164135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.164837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.166423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.179976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1163/2379] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:13:50.181477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.192493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50f0f7-dfb9-437c-a2c6-8e39c04c3735 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.198015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c3ef-7eae-4a12-a8dc-aacbc2057cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.199189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c3ef-7eae-4a12-a8dc-aacbc2057cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.199654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c3ef-7eae-4a12-a8dc-aacbc2057cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.200111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c3ef-7eae-4a12-a8dc-aacbc2057cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.201771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1c3ef-7eae-4a12-a8dc-aacbc2057cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.204118 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1c3ef-7eae-4a12-a8dc-aacbc2057cb0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.220296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1217/2380] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:13:50.221210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.231674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23906e55-c93e-425a-b498-c618e253b28b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.241768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.242742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.243137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.243486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] PATH_INFO: `/v3/projects/512ab3ef37cd49b6bc98bd1fd42e8197/users/06c80a63bc34428fb5496aed45daeded/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.252603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:50.259958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512ab3ef37cd49b6bc98bd1fd42e8197, user_id=06c80a63bc34428fb5496aed45daeded, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.263358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.340935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1164/2381] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:50 2022] PUT /identity/v3/projects/512ab3ef37cd49b6bc98bd1fd42e8197/users/06c80a63bc34428fb5496aed45daeded/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:13:50.351393 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb2b9-c2e3-42be-a428-b49377d170c8 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.351667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb2b9-c2e3-42be-a428-b49377d170c8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.351956 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb2b9-c2e3-42be-a428-b49377d170c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.379766 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-845fb2b9-c2e3-42be-a428-b49377d170c8 None None] MFA Rules not processed for user `06c80a63bc34428fb5496aed45daeded`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:50.380983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-845fb2b9-c2e3-42be-a428-b49377d170c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:50.444533 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1218/2382] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:50.449257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.517797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1265ab-2427-4131-95ae-b1e8c73df9e9 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.522915 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.523684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.523928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.524132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.524975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.526916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.608690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1165/2383] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:50 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:50.610006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb2b9-c2e3-42be-a428-b49377d170c8 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.620936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb2b9-c2e3-42be-a428-b49377d170c8 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.680387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.681080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.681319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.681593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.682332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.684276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.761810 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1219/2384] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:50 2022] POST /identity/v3/users => generated 301 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:50.766010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.776295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e97eda-9301-4a1d-8fc2-fc2bab887a91 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.781545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.782194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.782478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.782760 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.783524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.785134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.795990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1166/2385] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:50.800241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.810147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a0309-f250-453e-93a4-892bf24e23d1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.814708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.815729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.816011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.816289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] PATH_INFO: `/v3/projects/30e0cd5dfcc34dcca7f255328cebf80f/users/0feed88c61264c028a462c398473bf6f/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.831394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e0cd5dfcc34dcca7f255328cebf80f, user_id=0feed88c61264c028a462c398473bf6f, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.834012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:50.922489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1220/2386] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:50 2022] PUT /identity/v3/projects/30e0cd5dfcc34dcca7f255328cebf80f/users/0feed88c61264c028a462c398473bf6f/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:13:50.926460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:50.936889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546ba34-6cea-4444-b90c-809833110088 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:50.992895 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9354a4f-efe2-417b-976d-f0e05878581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:50.993556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9354a4f-efe2-417b-976d-f0e05878581a admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:50.993853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9354a4f-efe2-417b-976d-f0e05878581a admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:50.994122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9354a4f-efe2-417b-976d-f0e05878581a admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:50.994858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9354a4f-efe2-417b-976d-f0e05878581a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:50.996446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9354a4f-efe2-417b-976d-f0e05878581a admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:51.006471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1167/2387] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:51.010630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:51.016851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:51.021985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636c769-4df6-46cc-bd32-817a408a64e6 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:51.026650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:51.028005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:51.028005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:51.028243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] PATH_INFO: `/v3/projects/30e0cd5dfcc34dcca7f255328cebf80f/users/0feed88c61264c028a462c398473bf6f/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:51.030036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e0cd5dfcc34dcca7f255328cebf80f, user_id=0feed88c61264c028a462c398473bf6f, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:51.032676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:51.042789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1221/2388] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:51 2022] PUT /identity/v3/projects/30e0cd5dfcc34dcca7f255328cebf80f/users/0feed88c61264c028a462c398473bf6f/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:51.053719 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fab6-cac1-4e4b-8883-3166ce282d48 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:51.054009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fab6-cac1-4e4b-8883-3166ce282d48 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:51.054289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fab6-cac1-4e4b-8883-3166ce282d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:51.082577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-38f7fab6-cac1-4e4b-8883-3166ce282d48 None None] MFA Rules not processed for user `0feed88c61264c028a462c398473bf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:51.083900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-38f7fab6-cac1-4e4b-8883-3166ce282d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:51.128391 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:51.151583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1168/2389] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:51.162047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:51.163773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:51.221222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83512e78-8fc0-40d2-970e-7880b3c55512 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:51.225001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:51.225638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:51.225923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:51.226197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:51.236455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:51.238360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:51.249214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1222/2390] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:51.382781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fab6-cac1-4e4b-8883-3166ce282d48 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:51.445198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fab6-cac1-4e4b-8883-3166ce282d48 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:51.449700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:51.450598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:51.450917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:51.451234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] PATH_INFO: `/v3/users/06c80a63bc34428fb5496aed45daeded` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:51.452410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c80a63bc34428fb5496aed45daeded)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:51.454315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:51.648605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:51.650311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:51.652619 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c80a63bc34428fb5496aed45daeded'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:51.721713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaa87-c8f2-49b5-85bd-80c517435d7b service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:51.729241 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b20e9-cf18-48c3-935b-83221b0807e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:51.730036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b20e9-cf18-48c3-935b-83221b0807e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:51.730580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b20e9-cf18-48c3-935b-83221b0807e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:51.731092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b20e9-cf18-48c3-935b-83221b0807e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:51.734131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7d6b20e9-cf18-48c3-935b-83221b0807e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:51.746252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c80a63bc34428fb5496aed45daeded'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:51.749472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b20e9-cf18-48c3-935b-83221b0807e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:51.752133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b20e9-cf18-48c3-935b-83221b0807e6 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:51.768144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c80a63bc34428fb5496aed45daeded'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:51.769065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c80a63bc34428fb5496aed45daeded'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:51.769804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c80a63bc34428fb5496aed45daeded'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:51.770814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1223/2391] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:13:51.805233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1169/2392] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:51 2022] DELETE /identity/v3/users/06c80a63bc34428fb5496aed45daeded => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:51.809476 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:51.810332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:51.810615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:51.828916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:51.829801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:51.893091 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1224/2393] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:51.908927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:51.910339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:51.967192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40512b-9aa2-4ae7-b066-7946cc44d6fe admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:51.970769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:51.971451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:51.971737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:51.972016 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:51.981377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:51.983370 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:51.992937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1170/2394] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:13:52.399695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:52.401219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:52.414251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daba1a2-5147-421e-8d5a-b3ab14b0450f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:52.419681 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:52.420707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:52.421000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:52.421279 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] PATH_INFO: `/v3/projects/512ab3ef37cd49b6bc98bd1fd42e8197` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:52.422503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=512ab3ef37cd49b6bc98bd1fd42e8197)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:52.424830 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:52.557093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:52.570232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512ab3ef37cd49b6bc98bd1fd42e8197', 'request_id': 'req-0131fb83-14de-4da3-847c-a1a1bc4776bd'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:52.576857 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512ab3ef37cd49b6bc98bd1fd42e8197', 'request_id': 'req-0131fb83-14de-4da3-847c-a1a1bc4776bd'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:52.582544 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512ab3ef37cd49b6bc98bd1fd42e8197', 'request_id': 'req-0131fb83-14de-4da3-847c-a1a1bc4776bd'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:52.705981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] The token cache is being invalidate because project 512ab3ef37cd49b6bc98bd1fd42e8197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:52.706292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:52.706927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:52.708682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1225/2395] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:52 2022] DELETE /identity/v3/projects/512ab3ef37cd49b6bc98bd1fd42e8197 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:52.712551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:52.719501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:52.722831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a27cc-7041-4e4c-aa41-c0a4887a6776 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:52.779728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:52.780594 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:52.780882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:52.781165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] PATH_INFO: `/v3/users/0feed88c61264c028a462c398473bf6f` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:52.782361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0feed88c61264c028a462c398473bf6f)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:52.784354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:52.983268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0feed88c61264c028a462c398473bf6f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.054747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0feed88c61264c028a462c398473bf6f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.062637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0feed88c61264c028a462c398473bf6f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.066098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0feed88c61264c028a462c398473bf6f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.066098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-54556a9d-686b-4b55-af91-700ec1cfb4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0feed88c61264c028a462c398473bf6f'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.084228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1171/2396] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:52 2022] DELETE /identity/v3/users/0feed88c61264c028a462c398473bf6f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:53.513113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:53.515653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:53.548142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131fb83-14de-4da3-847c-a1a1bc4776bd admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:53.613551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:53.613940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:53.614221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:53.614495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] PATH_INFO: `/v3/projects/30e0cd5dfcc34dcca7f255328cebf80f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:53.616236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e0cd5dfcc34dcca7f255328cebf80f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:53.618136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:53.762323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e0cd5dfcc34dcca7f255328cebf80f', 'request_id': 'req-fead6788-cd11-477e-8f78-59b1b946199d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.770485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e0cd5dfcc34dcca7f255328cebf80f', 'request_id': 'req-fead6788-cd11-477e-8f78-59b1b946199d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.783355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e0cd5dfcc34dcca7f255328cebf80f', 'request_id': 'req-fead6788-cd11-477e-8f78-59b1b946199d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.881821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] The token cache is being invalidate because project 30e0cd5dfcc34dcca7f255328cebf80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:53.882115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.882964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-fead6788-cd11-477e-8f78-59b1b946199d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:53.884707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1226/2397] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:53 2022] DELETE /identity/v3/projects/30e0cd5dfcc34dcca7f255328cebf80f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:53.890093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f45c6-b1f0-4955-8578-206b5b9f30c0 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:53.890560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f45c6-b1f0-4955-8578-206b5b9f30c0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:53.890643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f45c6-b1f0-4955-8578-206b5b9f30c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:53.908705 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1a4f45c6-b1f0-4955-8578-206b5b9f30c0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:53.909910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1a4f45c6-b1f0-4955-8578-206b5b9f30c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:53.983280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1172/2398] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:53.991228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741e00-d474-46ff-86a4-c4afda170c66 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:53.992116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741e00-d474-46ff-86a4-c4afda170c66 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:53.992116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741e00-d474-46ff-86a4-c4afda170c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.011969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a2741e00-d474-46ff-86a4-c4afda170c66 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:54.013802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a2741e00-d474-46ff-86a4-c4afda170c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:54.023185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1227/2399] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:54.026261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f45c6-b1f0-4955-8578-206b5b9f30c0 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.036293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f45c6-b1f0-4955-8578-206b5b9f30c0 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.041205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.043702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.043702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.043702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.043702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:13:54.043702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.045257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.058032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1173/2400] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:13:54.064430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741e00-d474-46ff-86a4-c4afda170c66 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.078068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741e00-d474-46ff-86a4-c4afda170c66 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.094410 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.095702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.096056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.096400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.097738 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.101632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.187459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1228/2401] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:54 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:13:54.188943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.205324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a456587-9f94-49c4-9884-4ed82d0ca726 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.215245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:54.272858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.273534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.273875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.274097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.274802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.276857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.377924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1174/2402] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:54 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:13:54.379119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.389853 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e20375-50cd-4117-8d37-df7c24f33e1f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.394441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.395189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.395469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.395744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.396474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.398052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.409319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1229/2403] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:54.413317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.423221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387323-b515-4c9d-b2e1-f46e367f963d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.427863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb78f-4ea9-46d1-ba63-3590438f2a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.428517 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb78f-4ea9-46d1-ba63-3590438f2a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.428800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb78f-4ea9-46d1-ba63-3590438f2a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.429084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb78f-4ea9-46d1-ba63-3590438f2a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.429794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eb78f-4ea9-46d1-ba63-3590438f2a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.431447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eb78f-4ea9-46d1-ba63-3590438f2a8e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.441371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1175/2404] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:54.445744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.457033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb5676-6ea3-4871-aece-44eda17999be admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.461783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.462791 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.463111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.463391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] PATH_INFO: `/v3/projects/38568d2a644a40b1bc662e0ae5513e30/users/eafe5e75495548308f743af9c8cca8ce/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.467385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:54.481045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38568d2a644a40b1bc662e0ae5513e30, user_id=eafe5e75495548308f743af9c8cca8ce, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.483867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.559624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1230/2405] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:54 2022] PUT /identity/v3/projects/38568d2a644a40b1bc662e0ae5513e30/users/eafe5e75495548308f743af9c8cca8ce/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:54.571018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81811819-6364-4353-b379-85376c1cb778 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.571324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81811819-6364-4353-b379-85376c1cb778 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.571604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81811819-6364-4353-b379-85376c1cb778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.602683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-81811819-6364-4353-b379-85376c1cb778 None None] MFA Rules not processed for user `eafe5e75495548308f743af9c8cca8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:54.604313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-81811819-6364-4353-b379-85376c1cb778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:54.677589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1176/2406] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:54.690441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.692283 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:54.750872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c44c2-6679-45d6-b964-8a9246321a43 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.754591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb43d6-ff60-4193-906c-0eb6a40a0ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.755301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb43d6-ff60-4193-906c-0eb6a40a0ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.755583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb43d6-ff60-4193-906c-0eb6a40a0ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.755862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb43d6-ff60-4193-906c-0eb6a40a0ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.764916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb43d6-ff60-4193-906c-0eb6a40a0ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.766378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb43d6-ff60-4193-906c-0eb6a40a0ed1 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.775233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1231/2407] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:54.793909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81811819-6364-4353-b379-85376c1cb778 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:54.855229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81811819-6364-4353-b379-85376c1cb778 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:54.860745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:54.861618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:54.861898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:54.862223 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] PATH_INFO: `/v3/users/eafe5e75495548308f743af9c8cca8ce` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:54.863450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eafe5e75495548308f743af9c8cca8ce)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:54.865565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:54.898140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:55.121929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eafe5e75495548308f743af9c8cca8ce'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:55.196680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eafe5e75495548308f743af9c8cca8ce'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:55.209560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eafe5e75495548308f743af9c8cca8ce'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:55.210563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eafe5e75495548308f743af9c8cca8ce'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:55.211603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eafe5e75495548308f743af9c8cca8ce'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:55.231004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1177/2408] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:54 2022] DELETE /identity/v3/users/eafe5e75495548308f743af9c8cca8ce => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:55.237712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:55.237712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:55.237712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:55.255894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:55.257121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:55.390645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1232/2409] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:55.400515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:55.401982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:55.464647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983f9eb-635f-4756-b118-6c9b2996e741 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:55.469037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:55.469689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:55.470014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:55.470468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:55.481214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:55.483289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:55.494225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1178/2410] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:55.976684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:55.980711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:55.982180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:55.984285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:55.996147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbacd-6c09-4dff-a095-72606de3a50a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.000371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d1b08-4c1a-46cb-9418-d3a9f5ec7c5f service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.001641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.002626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.003040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.003442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] PATH_INFO: `/v3/users/abcbf501ca754212a16bbfbb901944f7` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.004748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcbf501ca754212a16bbfbb901944f7)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.006771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.018067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.018761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.019075 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.019348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] PATH_INFO: `/v3/projects/38568d2a644a40b1bc662e0ae5513e30` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.020644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38568d2a644a40b1bc662e0ae5513e30)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.022445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.254592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38568d2a644a40b1bc662e0ae5513e30', 'request_id': 'req-e701f589-ee1b-4a4d-9d6e-823b822fba00'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.261896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcbf501ca754212a16bbfbb901944f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.262152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38568d2a644a40b1bc662e0ae5513e30', 'request_id': 'req-e701f589-ee1b-4a4d-9d6e-823b822fba00'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.268277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38568d2a644a40b1bc662e0ae5513e30', 'request_id': 'req-e701f589-ee1b-4a4d-9d6e-823b822fba00'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.269640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcbf501ca754212a16bbfbb901944f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.270459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcbf501ca754212a16bbfbb901944f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.271101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcbf501ca754212a16bbfbb901944f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.284840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-472ae8f9-bcef-4b1b-b4c9-97cba8a3ee3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcbf501ca754212a16bbfbb901944f7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.346429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] The token cache is being invalidate because project 38568d2a644a40b1bc662e0ae5513e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:56.346667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.347285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e701f589-ee1b-4a4d-9d6e-823b822fba00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.348859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1179/2411] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:55 2022] DELETE /identity/v3/projects/38568d2a644a40b1bc662e0ae5513e30 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:56.354443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d9b58-f08f-45ef-94b7-1c65a4350bc6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.354736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d9b58-f08f-45ef-94b7-1c65a4350bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.355064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d9b58-f08f-45ef-94b7-1c65a4350bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.374248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-1c0d9b58-f08f-45ef-94b7-1c65a4350bc6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:56.375497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1c0d9b58-f08f-45ef-94b7-1c65a4350bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:56.383889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:56.393155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1233/2412] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:55 2022] DELETE /identity/v3/users/abcbf501ca754212a16bbfbb901944f7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:56.398811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:56.444294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1180/2413] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:13:56.452624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734f88-b9af-45f9-94b9-2d69cb89e89f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.452919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734f88-b9af-45f9-94b9-2d69cb89e89f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.453198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734f88-b9af-45f9-94b9-2d69cb89e89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.472133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d9734f88-b9af-45f9-94b9-2d69cb89e89f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:56.473425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d9734f88-b9af-45f9-94b9-2d69cb89e89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:56.534803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1234/2414] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:56.537751 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d9b58-f08f-45ef-94b7-1c65a4350bc6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:56.548065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d9b58-f08f-45ef-94b7-1c65a4350bc6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.552740 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.553515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.553801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.554081 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.554864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:13:56.555177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.556856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.569286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1181/2415] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:13:56.573683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734f88-b9af-45f9-94b9-2d69cb89e89f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:56.583102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734f88-b9af-45f9-94b9-2d69cb89e89f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.587983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.588635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.588937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.589204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.589887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.591889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.621767 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:56.624303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:56.638248 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bc92-6066-413d-b4f7-7c185446525f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.644113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.645175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.645464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.645743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] PATH_INFO: `/v3/projects/b887d876b7624299b5575036da211d6b` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.647290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b887d876b7624299b5575036da211d6b)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.649369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.707770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1235/2416] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:56 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:56.711629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:56.769826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b887d876b7624299b5575036da211d6b', 'request_id': 'req-38018d86-13ea-40cb-a86a-cbf5a0153721'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.778602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b887d876b7624299b5575036da211d6b', 'request_id': 'req-38018d86-13ea-40cb-a86a-cbf5a0153721'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.784898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b887d876b7624299b5575036da211d6b', 'request_id': 'req-38018d86-13ea-40cb-a86a-cbf5a0153721'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.793522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14e47-b579-4bff-8c91-7b138bc856a4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.852092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.852768 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.853057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.853338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.854342 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.856922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.878959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] The token cache is being invalidate because project b887d876b7624299b5575036da211d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:13:56.879176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.879863 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-38018d86-13ea-40cb-a86a-cbf5a0153721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:56.881788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1182/2417] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:13:56 2022] DELETE /identity/v3/projects/b887d876b7624299b5575036da211d6b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:13:56.886395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23044378-b563-4de1-bee6-9fe83cd77c0b None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.886683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23044378-b563-4de1-bee6-9fe83cd77c0b None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.886998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23044378-b563-4de1-bee6-9fe83cd77c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.905260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-23044378-b563-4de1-bee6-9fe83cd77c0b None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:56.906597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-23044378-b563-4de1-bee6-9fe83cd77c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:56.914963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1183/2418] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:13:56.923384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc3953-7bad-4645-8543-a85cf3016041 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.923743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc3953-7bad-4645-8543-a85cf3016041 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.924022 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc3953-7bad-4645-8543-a85cf3016041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.941896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1236/2419] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:56 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:13:56.942741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-29fc3953-7bad-4645-8543-a85cf3016041 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:56.943962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-29fc3953-7bad-4645-8543-a85cf3016041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:56.945688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:56.947409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:56.952588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1184/2420] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:13:56.956548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc3953-7bad-4645-8543-a85cf3016041 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:56.959915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c72b3-9c8c-4b65-b1bb-99c61dd5332d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.964867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.966317 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.966605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.966921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.967496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc3953-7bad-4645-8543-a85cf3016041 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:56.967697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.969286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.973346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:56.974028 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:56.974316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:56.974592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:56.975353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:13:56.978604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:56.978604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:56.980677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1237/2421] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:13:56.985002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:56.996343 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1185/2422] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:13:57.001486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e41ea-c3fe-44bb-b22c-e7d1d6f3c8a1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.001602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.001718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.001718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.001718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.001718 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.002215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.003844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.007375 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0069-35f1-43af-afaa-4c0f1ef7a822 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.012120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.012792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.013206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.013484 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.014165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.014779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1238/2423] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:13:57.016071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.019034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.029363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832016-bc05-45b1-bf49-c4e8cddd11be admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.034359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef6470-27ed-4fd8-8642-1831369188f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.039511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6470-27ed-4fd8-8642-1831369188f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.039511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6470-27ed-4fd8-8642-1831369188f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.039511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6470-27ed-4fd8-8642-1831369188f3 admin admin] PATH_INFO: `/v3/projects/8ff6ca4789ba4ff7a820eddc96c5b3c2/users/7a75c711219a4f1bb01118dea3da1e4d/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.050724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef6470-27ed-4fd8-8642-1831369188f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff6ca4789ba4ff7a820eddc96c5b3c2, user_id=7a75c711219a4f1bb01118dea3da1e4d, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.053401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef6470-27ed-4fd8-8642-1831369188f3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.114282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1186/2424] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:56 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:57.118160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.139061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1239/2425] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:57 2022] PUT /identity/v3/projects/8ff6ca4789ba4ff7a820eddc96c5b3c2/users/7a75c711219a4f1bb01118dea3da1e4d/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:57.147963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.148264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.148576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.176521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] MFA Rules not processed for user `7a75c711219a4f1bb01118dea3da1e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:57.177927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:57.179786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308d97-a2eb-4820-ab38-1b82c48269de admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.187204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:57.214240 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:57.237247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.237850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.238144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.238414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.239136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.241078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.243799 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1240/2426] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:13:57.255662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.257021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:57.303967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1187/2427] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:57 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:13:57.305139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.315668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce809-c689-4288-90c3-2540b893dac2 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.317312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724ecc-0903-4a5e-942c-545e699e8d5a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.320493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.321153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.321398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.321567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.321696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.322251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.322608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.322982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.323144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.324993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.335231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.338885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1188/2428] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:57.339023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.339893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.348113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1241/2429] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:13:57.365174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c7bc0-8443-458a-b7cb-61c04038e7b2 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.372385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabe168-3c08-4f01-a5e0-13e400c40e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.373066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe168-3c08-4f01-a5e0-13e400c40e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.373352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe168-3c08-4f01-a5e0-13e400c40e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.373626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe168-3c08-4f01-a5e0-13e400c40e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.374355 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabe168-3c08-4f01-a5e0-13e400c40e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.376065 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabe168-3c08-4f01-a5e0-13e400c40e02 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.388441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1189/2430] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:57.392639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.405343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb745-98df-4453-8127-2d1f8bf8478a service glance] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.412817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.413821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.414269 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.414638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] PATH_INFO: `/v3/projects/462e3545658544e0b70c897193bd2ec6/users/9c7f06ca6ea8443183f8d627b25a52a4/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.440561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462e3545658544e0b70c897193bd2ec6, user_id=9c7f06ca6ea8443183f8d627b25a52a4, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.443233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.501455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1242/2431] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:57 2022] PUT /identity/v3/projects/462e3545658544e0b70c897193bd2ec6/users/9c7f06ca6ea8443183f8d627b25a52a4/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:13:57.512371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51837cf-57c4-4142-8dcc-2b5895b8e37a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.518176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51837cf-57c4-4142-8dcc-2b5895b8e37a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.518176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51837cf-57c4-4142-8dcc-2b5895b8e37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.541731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d51837cf-57c4-4142-8dcc-2b5895b8e37a None None] MFA Rules not processed for user `9c7f06ca6ea8443183f8d627b25a52a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:57.542952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d51837cf-57c4-4142-8dcc-2b5895b8e37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:57.608216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1190/2432] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:57.612687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.655428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:57.675554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d38ac-6988-4f71-bb18-00fd61b66dc9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.680420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.681066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.681366 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.681639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.682563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.684928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.794083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1243/2433] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:13:57 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:57.797532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51837cf-57c4-4142-8dcc-2b5895b8e37a None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.809179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51837cf-57c4-4142-8dcc-2b5895b8e37a None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:57.857743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:57.867293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:57.867961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:57.868244 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:57.868521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:57.869210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:57.871285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:57.995114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1191/2434] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:13:57 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:13:57.996701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:58.007805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e2a75-61a3-4ed3-9d82-f205965b48ae admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:58.014559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:58.015271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.015555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.015829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.016716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:58.018459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:58.034276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1244/2435] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:58.038477 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:58.049486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36806b5-d457-4608-acbb-04ef8681826f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:58.054445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:58.055403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.055685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.055962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] PATH_INFO: `/v3/projects/db9b739477fd4c7ca35e6f98f086dca9/users/946bdef06de64a8db94903b70a16011a/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.071676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9b739477fd4c7ca35e6f98f086dca9, user_id=946bdef06de64a8db94903b70a16011a, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:58.074524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:58.130489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1192/2436] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:58 2022] PUT /identity/v3/projects/db9b739477fd4c7ca35e6f98f086dca9/users/946bdef06de64a8db94903b70a16011a/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:58.137428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:58.147622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2fc86-1101-46dd-923d-34883438fe13 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:58.209949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4849ab8-760f-408d-8586-98e483998c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:58.210677 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4849ab8-760f-408d-8586-98e483998c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.210998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4849ab8-760f-408d-8586-98e483998c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.211330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4849ab8-760f-408d-8586-98e483998c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.212263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4849ab8-760f-408d-8586-98e483998c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:58.213880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4849ab8-760f-408d-8586-98e483998c40 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:58.223831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1245/2437] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:13:58.228118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:58.239304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef333d-71bb-46e6-a3be-8c2a8341c325 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:58.243889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:58.244754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.245037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.245314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] PATH_INFO: `/v3/projects/db9b739477fd4c7ca35e6f98f086dca9/users/946bdef06de64a8db94903b70a16011a/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.248077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9b739477fd4c7ca35e6f98f086dca9, user_id=946bdef06de64a8db94903b70a16011a, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:58.250694 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:58.260877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1193/2438] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:13:58 2022] PUT /identity/v3/projects/db9b739477fd4c7ca35e6f98f086dca9/users/946bdef06de64a8db94903b70a16011a/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:13:58.271035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70581b6e-bf93-4b63-a82f-e5550621c785 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.271326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70581b6e-bf93-4b63-a82f-e5550621c785 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.271605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70581b6e-bf93-4b63-a82f-e5550621c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.298312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-70581b6e-bf93-4b63-a82f-e5550621c785 None None] MFA Rules not processed for user `946bdef06de64a8db94903b70a16011a`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:58.303443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-70581b6e-bf93-4b63-a82f-e5550621c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:58.369472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1246/2439] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:13:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:58.381901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:58.383855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:58.440925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd183fb4-657a-4e14-a060-c185a295c8ba admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:58.444873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b180247-69ba-4145-b521-7c5cdf403992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:58.445764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b180247-69ba-4145-b521-7c5cdf403992 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.446050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b180247-69ba-4145-b521-7c5cdf403992 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.446449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b180247-69ba-4145-b521-7c5cdf403992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.458380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b180247-69ba-4145-b521-7c5cdf403992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:58.459981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b180247-69ba-4145-b521-7c5cdf403992 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:58.469960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1194/2440] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:58.685478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70581b6e-bf93-4b63-a82f-e5550621c785 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:58.695907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70581b6e-bf93-4b63-a82f-e5550621c785 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:58.699483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:58.700285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.700518 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.700794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.734774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:58.760997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:58.762433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:58.773009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1247/2441] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:07.363438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940a3b2-9d3c-41c7-a47e-f1494e32f610 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:07.363902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940a3b2-9d3c-41c7-a47e-f1494e32f610 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:07.364057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940a3b2-9d3c-41c7-a47e-f1494e32f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:07.382675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-9940a3b2-9d3c-41c7-a47e-f1494e32f610 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:07.383908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9940a3b2-9d3c-41c7-a47e-f1494e32f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:07.441247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1195/2442] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:14:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:07.482153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:07.483654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:07.552202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee11137-de1a-4789-a3c7-c7ff0e4e91da service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:07.557137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c4cef-0857-4e00-a0e8-c686d34f4568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:07.557793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4cef-0857-4e00-a0e8-c686d34f4568 service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:07.558075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4cef-0857-4e00-a0e8-c686d34f4568 service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:07.558353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4cef-0857-4e00-a0e8-c686d34f4568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:07.567788 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c4cef-0857-4e00-a0e8-c686d34f4568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:07.569381 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c4cef-0857-4e00-a0e8-c686d34f4568 service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:07.577998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1248/2443] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:14:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:14:17.433764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:17.574148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=45 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:29.313884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a7ca-19a9-4bd4-82c2-3ab770946e99 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:29.314338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a7ca-19a9-4bd4-82c2-3ab770946e99 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:29.314648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a7ca-19a9-4bd4-82c2-3ab770946e99 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:29.316124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1196/2444] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:14:29.322412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6449b-c3ec-4bc7-b0d2-c06b445e13d1 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:29.322868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6449b-c3ec-4bc7-b0d2-c06b445e13d1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:29.323017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6449b-c3ec-4bc7-b0d2-c06b445e13d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:29.342792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c5d6449b-c3ec-4bc7-b0d2-c06b445e13d1 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:29.344459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c5d6449b-c3ec-4bc7-b0d2-c06b445e13d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:29.412550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1249/2445] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:14:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:29.424193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a7ca-19a9-4bd4-82c2-3ab770946e99 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:29.425844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1027a7ca-19a9-4bd4-82c2-3ab770946e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:29.484620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a7ca-19a9-4bd4-82c2-3ab770946e99 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:29.488892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdf7c3-6ea4-4390-99ff-6517a21eb6af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a49aca72844411b6bc1feff566cc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:29.489569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdf7c3-6ea4-4390-99ff-6517a21eb6af service glance] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:29.489851 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdf7c3-6ea4-4390-99ff-6517a21eb6af service glance] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:29.490150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdf7c3-6ea4-4390-99ff-6517a21eb6af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:29.504302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdf7c3-6ea4-4390-99ff-6517a21eb6af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:29.504302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdf7c3-6ea4-4390-99ff-6517a21eb6af service glance] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:29.513229 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1197/2446] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:29.777356 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d1985-a339-4413-8b08-be12ed9ac8a1 None None] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:29.778016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d1985-a339-4413-8b08-be12ed9ac8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:29.778016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d1985-a339-4413-8b08-be12ed9ac8a1 None None] PATH_INFO: `/` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:29.780064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1250/2447] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:14:29.787492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192477-a662-43dd-8cbd-10b49a85736a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:29.788780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192477-a662-43dd-8cbd-10b49a85736a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:29.789142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192477-a662-43dd-8cbd-10b49a85736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:29.816300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-48192477-a662-43dd-8cbd-10b49a85736a None None] MFA Rules not processed for user `c6bbb0e4d7ca44fc8cb68fdc96260caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:29.817495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-48192477-a662-43dd-8cbd-10b49a85736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:29.869527 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1198/2448] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:14:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:29.881990 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d1985-a339-4413-8b08-be12ed9ac8a1 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:29.883737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-657d1985-a339-4413-8b08-be12ed9ac8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:29.897335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d1985-a339-4413-8b08-be12ed9ac8a1 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:29.900838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa308a-fa44-4b8e-8ac3-567d70cf13e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:29.901475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa308a-fa44-4b8e-8ac3-567d70cf13e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:29.901762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa308a-fa44-4b8e-8ac3-567d70cf13e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:29.902039 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa308a-fa44-4b8e-8ac3-567d70cf13e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:29.908991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa308a-fa44-4b8e-8ac3-567d70cf13e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:29.910402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa308a-fa44-4b8e-8ac3-567d70cf13e8 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:29.919599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1251/2449] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:30.013201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14822a-e39b-4566-b1d4-9756315fbda4 None None] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:30.014260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14822a-e39b-4566-b1d4-9756315fbda4 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:30.014363 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14822a-e39b-4566-b1d4-9756315fbda4 None None] PATH_INFO: `/` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:30.015787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1199/2450] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 22 09:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:14:30.021737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb5ada-fe41-4813-8b14-e1136e349155 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:30.022150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb5ada-fe41-4813-8b14-e1136e349155 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:30.022527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb5ada-fe41-4813-8b14-e1136e349155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:30.041355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-36fb5ada-fe41-4813-8b14-e1136e349155 None None] MFA Rules not processed for user `4c0cbf8022ee4c37a591ee578b53806c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:30.042566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-36fb5ada-fe41-4813-8b14-e1136e349155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:30.052000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1252/2451] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 22 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:30.063274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14822a-e39b-4566-b1d4-9756315fbda4 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:30.074090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14822a-e39b-4566-b1d4-9756315fbda4 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:30.078329 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:30.078994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:30.079300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:30.079563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:30.090033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:30.091502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:30.102501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1200/2452] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:38.805657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101166-fd36-47f6-b14b-11c80b7c5f57 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:38.806097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101166-fd36-47f6-b14b-11c80b7c5f57 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:38.806332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101166-fd36-47f6-b14b-11c80b7c5f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:38.829488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-04101166-fd36-47f6-b14b-11c80b7c5f57 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:38.830944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-04101166-fd36-47f6-b14b-11c80b7c5f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:38.839770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1253/2453] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:38.857870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:38.869834 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3c4a0-d67d-4d7c-b18e-4c33f984f277 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:38.875208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d62a45-2a10-489c-9ba9-d63dcc4d4ba0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:38.876058 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62a45-2a10-489c-9ba9-d63dcc4d4ba0 service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:38.876338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62a45-2a10-489c-9ba9-d63dcc4d4ba0 service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:38.876612 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62a45-2a10-489c-9ba9-d63dcc4d4ba0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:38.885119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d62a45-2a10-489c-9ba9-d63dcc4d4ba0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:38.886717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d62a45-2a10-489c-9ba9-d63dcc4d4ba0 service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:38.898971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1201/2454] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:14:40.326351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101166-fd36-47f6-b14b-11c80b7c5f57 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:40.441846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101166-fd36-47f6-b14b-11c80b7c5f57 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:40.447450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:40.448771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:40.449186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:40.449531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] PATH_INFO: `/v3/users/7a75c711219a4f1bb01118dea3da1e4d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:40.451455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a75c711219a4f1bb01118dea3da1e4d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:40.453631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:40.649724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a75c711219a4f1bb01118dea3da1e4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:40.657098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a75c711219a4f1bb01118dea3da1e4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:40.657832 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a75c711219a4f1bb01118dea3da1e4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:40.658489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a75c711219a4f1bb01118dea3da1e4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:40.668713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:40.684384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a75c711219a4f1bb01118dea3da1e4d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:40.746248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1254/2455] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:40 2022] DELETE /identity/v3/users/7a75c711219a4f1bb01118dea3da1e4d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:40.751787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:40.752304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:40.752564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:40.786804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:40.788446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:40.877398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1202/2456] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:14:40.884365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:40.886100 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:40.946314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368f88-090c-4fbc-8691-80f52ac43110 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:40.950215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4a6b3-6077-48dc-9c99-8ce3826e85d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:40.950929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4a6b3-6077-48dc-9c99-8ce3826e85d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:40.951222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4a6b3-6077-48dc-9c99-8ce3826e85d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:40.951494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4a6b3-6077-48dc-9c99-8ce3826e85d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:40.961026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4a6b3-6077-48dc-9c99-8ce3826e85d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:40.962456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4a6b3-6077-48dc-9c99-8ce3826e85d8 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:40.972022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1255/2457] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:41.404815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:41.407115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:41.421792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002840a2-26e8-4e6c-a238-5795bcc4b43a None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:41.426893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:41.427807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:41.428096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:41.428398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] PATH_INFO: `/v3/projects/8ff6ca4789ba4ff7a820eddc96c5b3c2` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:41.429964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff6ca4789ba4ff7a820eddc96c5b3c2)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:41.432312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:41.462100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:41.600000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff6ca4789ba4ff7a820eddc96c5b3c2', 'request_id': 'req-115a5244-c3e7-484c-84a9-0a19f02e60ae'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:41.606427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff6ca4789ba4ff7a820eddc96c5b3c2', 'request_id': 'req-115a5244-c3e7-484c-84a9-0a19f02e60ae'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:41.611955 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff6ca4789ba4ff7a820eddc96c5b3c2', 'request_id': 'req-115a5244-c3e7-484c-84a9-0a19f02e60ae'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:41.710847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] The token cache is being invalidate because project 8ff6ca4789ba4ff7a820eddc96c5b3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:41.711309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:41.712086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-115a5244-c3e7-484c-84a9-0a19f02e60ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:41.713789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1203/2458] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:41 2022] DELETE /identity/v3/projects/8ff6ca4789ba4ff7a820eddc96c5b3c2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:41.719605 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3fd97-d33b-44b1-a63d-c8e6d2752d58 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:41.720216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3fd97-d33b-44b1-a63d-c8e6d2752d58 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:41.720216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3fd97-d33b-44b1-a63d-c8e6d2752d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:41.740004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-90e3fd97-d33b-44b1-a63d-c8e6d2752d58 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:41.741239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-90e3fd97-d33b-44b1-a63d-c8e6d2752d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:41.804526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1256/2459] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:41.814289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8fa7-c4de-44c3-8652-0c65f240c9d2 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:41.814941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8fa7-c4de-44c3-8652-0c65f240c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:41.814941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8fa7-c4de-44c3-8652-0c65f240c9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:41.838581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f01d8fa7-c4de-44c3-8652-0c65f240c9d2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:41.839982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f01d8fa7-c4de-44c3-8652-0c65f240c9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:41.850234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1204/2460] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:41.855154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3fd97-d33b-44b1-a63d-c8e6d2752d58 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:41.870610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3fd97-d33b-44b1-a63d-c8e6d2752d58 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:41.879569 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:41.880595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:41.880890 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:41.881179 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:41.881928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:14:41.882242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:41.883886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:41.907365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1257/2461] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:14:41.911580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d8fa7-c4de-44c3-8652-0c65f240c9d2 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:41.943039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d8fa7-c4de-44c3-8652-0c65f240c9d2 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:41.969300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:41.970089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:41.970448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:41.970792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:41.973272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:41.977451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:42.078839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1205/2462] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:41 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:14:42.082892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:42.092782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f537e0-bdf5-478c-9e58-84c16fb29fe2 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:42.149422 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:42.150005 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:42.150285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:42.150560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:42.151290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:42.153218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:42.279078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1258/2463] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:42 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:42.286995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:42.303776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de2f1-b153-462a-8dca-27b34d6a08a4 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:42.311194 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:42.315380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:42.315380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:42.315380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:42.315380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:42.318313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:42.335971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1206/2464] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:42.336977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:42.353686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:42.366930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c81d1-0f69-4152-b80c-3280b4426ab3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:42.371797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab0317-4a4e-4768-a4b9-35c96af7d217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:42.372478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0317-4a4e-4768-a4b9-35c96af7d217 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:42.373353 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0317-4a4e-4768-a4b9-35c96af7d217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:42.373679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0317-4a4e-4768-a4b9-35c96af7d217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:42.374417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0317-4a4e-4768-a4b9-35c96af7d217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:42.380604 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0317-4a4e-4768-a4b9-35c96af7d217 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:42.397917 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1259/2465] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:42.402899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:42.417392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86519648-6c15-4f59-ae37-ad62c078e968 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:42.424675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:42.424675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:42.424675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:42.425061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] PATH_INFO: `/v3/projects/0d9b74fd5e3e4caea79615a35773ae89/users/49faae34e6f84699972d9ab88dcc2b4f/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:42.441469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9b74fd5e3e4caea79615a35773ae89, user_id=49faae34e6f84699972d9ab88dcc2b4f, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:42.444305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:42.557797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1207/2466] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:42 2022] PUT /identity/v3/projects/0d9b74fd5e3e4caea79615a35773ae89/users/49faae34e6f84699972d9ab88dcc2b4f/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:42.569079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fb6e-f7cd-4126-9a95-9b097e03961b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:42.569380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fb6e-f7cd-4126-9a95-9b097e03961b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:42.569667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fb6e-f7cd-4126-9a95-9b097e03961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:42.600927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5483fb6e-f7cd-4126-9a95-9b097e03961b None None] MFA Rules not processed for user `49faae34e6f84699972d9ab88dcc2b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:42.602206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5483fb6e-f7cd-4126-9a95-9b097e03961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:42.679875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1260/2467] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:42.691338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:42.693275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:42.759765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba6a75-f257-4fee-926d-d495a2ddde9e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:42.763438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93599cb-37ce-45c6-9ee5-fef07b651422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:42.764090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93599cb-37ce-45c6-9ee5-fef07b651422 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:42.764374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93599cb-37ce-45c6-9ee5-fef07b651422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:42.764651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93599cb-37ce-45c6-9ee5-fef07b651422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:42.773274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93599cb-37ce-45c6-9ee5-fef07b651422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:42.774720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93599cb-37ce-45c6-9ee5-fef07b651422 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:42.784539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1208/2468] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:42.808668 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fb6e-f7cd-4126-9a95-9b097e03961b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:42.873181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fb6e-f7cd-4126-9a95-9b097e03961b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:42.877719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:42.878580 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:42.878884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:42.879166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] PATH_INFO: `/v3/users/49faae34e6f84699972d9ab88dcc2b4f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:42.880385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49faae34e6f84699972d9ab88dcc2b4f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:42.882285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:43.098055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49faae34e6f84699972d9ab88dcc2b4f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:43.108984 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49faae34e6f84699972d9ab88dcc2b4f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:43.109994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49faae34e6f84699972d9ab88dcc2b4f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:43.111098 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49faae34e6f84699972d9ab88dcc2b4f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:43.132975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49faae34e6f84699972d9ab88dcc2b4f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:43.253114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1261/2469] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:42 2022] DELETE /identity/v3/users/49faae34e6f84699972d9ab88dcc2b4f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:43.261727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:43.262295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:43.262295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:43.288827 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:43.290051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:43.337309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:43.352608 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1209/2470] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:43.363654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:43.369330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:43.376004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:43.460936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9e57-bc72-42cf-91bc-86a0f6b3a4a5 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:43.476633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d03ec-8a2f-40db-828b-53d32d82eb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:43.477486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d03ec-8a2f-40db-828b-53d32d82eb5a service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:43.477842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d03ec-8a2f-40db-828b-53d32d82eb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:43.478191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d03ec-8a2f-40db-828b-53d32d82eb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:43.491901 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d03ec-8a2f-40db-828b-53d32d82eb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:43.493755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d03ec-8a2f-40db-828b-53d32d82eb5a service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:43.506496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1262/2471] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:44.610215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:44.612341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:44.627906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d60ec5-b9d1-4f8d-af59-7e37e04853ec None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:44.635911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:44.635911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:44.635911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:44.635911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] PATH_INFO: `/v3/projects/0d9b74fd5e3e4caea79615a35773ae89` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:44.636492 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9b74fd5e3e4caea79615a35773ae89)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:44.638154 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:44.766175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9b74fd5e3e4caea79615a35773ae89', 'request_id': 'req-142955ad-6f30-4b6b-87d2-b7666719ad76'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:44.782702 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9b74fd5e3e4caea79615a35773ae89', 'request_id': 'req-142955ad-6f30-4b6b-87d2-b7666719ad76'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:44.789984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9b74fd5e3e4caea79615a35773ae89', 'request_id': 'req-142955ad-6f30-4b6b-87d2-b7666719ad76'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:44.856324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] The token cache is being invalidate because project 0d9b74fd5e3e4caea79615a35773ae89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:44.856873 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:44.857750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-142955ad-6f30-4b6b-87d2-b7666719ad76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:44.867152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1210/2472] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:44 2022] DELETE /identity/v3/projects/0d9b74fd5e3e4caea79615a35773ae89 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:44.870122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d582af-cec6-44ea-92f9-ef93f7c45752 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:44.870655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d582af-cec6-44ea-92f9-ef93f7c45752 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:44.870886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d582af-cec6-44ea-92f9-ef93f7c45752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:44.889947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-c8d582af-cec6-44ea-92f9-ef93f7c45752 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:44.891290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c8d582af-cec6-44ea-92f9-ef93f7c45752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:44.987749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1263/2473] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:14:44.995614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7d46-f23f-4503-bd3c-d26cd2927ac3 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:44.998974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7d46-f23f-4503-bd3c-d26cd2927ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:44.998974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7d46-f23f-4503-bd3c-d26cd2927ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.031970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d8ca7d46-f23f-4503-bd3c-d26cd2927ac3 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:45.031970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d8ca7d46-f23f-4503-bd3c-d26cd2927ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:45.048918 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1211/2474] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:45.053359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d582af-cec6-44ea-92f9-ef93f7c45752 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:45.064103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d582af-cec6-44ea-92f9-ef93f7c45752 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:45.069031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:45.069817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.070221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.070570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.071425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:14:45.071735 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:45.073363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:45.086882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1264/2475] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:14:45.091661 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7d46-f23f-4503-bd3c-d26cd2927ac3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:45.102532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7d46-f23f-4503-bd3c-d26cd2927ac3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:45.107575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:45.108288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.108578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.108853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.109545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:45.111714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:45.220843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1212/2476] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:45 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:14:45.224939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:45.235679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc0f4-ba73-49f9-b98a-0583bbe17fca admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:45.308806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:45.309503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.309860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.310144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.310867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:45.313875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:45.402312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1265/2477] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:45 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:45.404813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:45.420378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c4cac-9a1b-4c2d-92b3-f80dcc93c1f6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:45.431534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:45.432225 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.432524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.432806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.433551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:45.435209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:45.453611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1213/2478] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:45.457587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:45.467682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9f9f9-8e2f-48fb-b73b-6b60672f7c33 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:45.472309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e31bc-ad80-4510-9e7a-10647b53885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:45.472958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e31bc-ad80-4510-9e7a-10647b53885a admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.473249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e31bc-ad80-4510-9e7a-10647b53885a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.473531 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e31bc-ad80-4510-9e7a-10647b53885a admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.474257 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e31bc-ad80-4510-9e7a-10647b53885a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:45.475873 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e31bc-ad80-4510-9e7a-10647b53885a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:45.486710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1266/2479] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:45.490758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:45.505499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94d7b-7502-490b-b10a-39f63a18025c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:45.506605 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:45.507518 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.507815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.508636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] PATH_INFO: `/v3/projects/49e0b907a77b45bc9c80330a0531ce1e/users/4a02e42fcffb4ff2a53cc89074ce117d/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.524002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e0b907a77b45bc9c80330a0531ce1e, user_id=4a02e42fcffb4ff2a53cc89074ce117d, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:45.528506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:45.616706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1214/2480] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:45 2022] PUT /identity/v3/projects/49e0b907a77b45bc9c80330a0531ce1e/users/4a02e42fcffb4ff2a53cc89074ce117d/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:45.685760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.686050 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.686339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.709454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:45.717256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] MFA Rules not processed for user `4a02e42fcffb4ff2a53cc89074ce117d`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:45.718538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:45.789583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1267/2481] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:45.800182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:45.801968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:45.858087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deab51-c4ba-4cab-beaf-6965a4ed9ead admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:45.861669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e77fb-85a5-499f-b738-c3fd3c3bd500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:45.862308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e77fb-85a5-499f-b738-c3fd3c3bd500 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:45.862595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e77fb-85a5-499f-b738-c3fd3c3bd500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:45.862897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e77fb-85a5-499f-b738-c3fd3c3bd500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:45.871193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e77fb-85a5-499f-b738-c3fd3c3bd500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:45.872633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e77fb-85a5-499f-b738-c3fd3c3bd500 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:45.881987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1215/2482] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:55.786725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=27 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:55.878143 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:57.616597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.618056 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:57.696382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afddd4-1acf-4e70-97f3-5cd99b9ebce5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.701162 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.702055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.702388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.702795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] PATH_INFO: `/v3/users/9c7f06ca6ea8443183f8d627b25a52a4` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.704072 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7f06ca6ea8443183f8d627b25a52a4)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.706054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:57.900662 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7f06ca6ea8443183f8d627b25a52a4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.908975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7f06ca6ea8443183f8d627b25a52a4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.909697 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7f06ca6ea8443183f8d627b25a52a4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.910314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7f06ca6ea8443183f8d627b25a52a4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.923191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7f06ca6ea8443183f8d627b25a52a4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.988349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1268/2483] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:57 2022] DELETE /identity/v3/users/9c7f06ca6ea8443183f8d627b25a52a4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:57.992749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.993680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.993864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.012504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:58.013759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:58.080927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1216/2484] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:14:58.103291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.106562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:58.197229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e8835-b17c-483b-856e-94e760bf605b admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.200925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.203122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.203417 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.203700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.213315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.214710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.233123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1269/2485] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:58.901822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.903367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:58.915813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb8515-3aab-4353-a8fc-219670c1c8df None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.920416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.921924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.922210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.922487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] PATH_INFO: `/v3/projects/462e3545658544e0b70c897193bd2ec6` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.923830 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462e3545658544e0b70c897193bd2ec6)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.926768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:59.050139 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462e3545658544e0b70c897193bd2ec6', 'request_id': 'req-05e0b08c-514c-4fb5-bddb-4950c43cbe64'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.057325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462e3545658544e0b70c897193bd2ec6', 'request_id': 'req-05e0b08c-514c-4fb5-bddb-4950c43cbe64'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.063671 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462e3545658544e0b70c897193bd2ec6', 'request_id': 'req-05e0b08c-514c-4fb5-bddb-4950c43cbe64'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.128221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] The token cache is being invalidate because project 462e3545658544e0b70c897193bd2ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:59.128512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.129140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-05e0b08c-514c-4fb5-bddb-4950c43cbe64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.130753 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1217/2486] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:58 2022] DELETE /identity/v3/projects/462e3545658544e0b70c897193bd2ec6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:59.134843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:59.144843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f327f28-98e2-4665-91a2-b4af721b0fdf service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:59.163390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:59.203442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:59.204358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:59.204646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:59.204928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] PATH_INFO: `/v3/users/946bdef06de64a8db94903b70a16011a` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:59.206152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946bdef06de64a8db94903b70a16011a)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:59.208231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:59.350287 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946bdef06de64a8db94903b70a16011a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.358067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946bdef06de64a8db94903b70a16011a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.359477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946bdef06de64a8db94903b70a16011a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.360242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946bdef06de64a8db94903b70a16011a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.373270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946bdef06de64a8db94903b70a16011a'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:59.442113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1270/2487] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:59 2022] DELETE /identity/v3/users/946bdef06de64a8db94903b70a16011a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:59.830715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:59.831041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:59.831321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:59.850446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:59.851929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:59.909542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1218/2488] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 22 09:14:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:59.921769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:59.923213 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:59.965196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:59.967271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:00.000059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c359b-2d96-470d-b6f8-869eaebc19f1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.004914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:00.006308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.006999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.007461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.007748 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.017837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.019595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.028359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1271/2489] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:14:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:00.056795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130f06-50ff-4099-b205-c69932b52d08 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.058086 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.059035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:00.064114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.064114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.064447 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.064536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] PATH_INFO: `/v3/projects/db9b739477fd4c7ca35e6f98f086dca9` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.066007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9b739477fd4c7ca35e6f98f086dca9)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.068505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.073390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e188c9-a0a8-4db8-9ebc-08977cbd225c service swift] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.079403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.080349 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.080582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.080864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] PATH_INFO: `/v3/users/4a02e42fcffb4ff2a53cc89074ce117d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.082193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a02e42fcffb4ff2a53cc89074ce117d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.084137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.182298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:00.191729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9b739477fd4c7ca35e6f98f086dca9', 'request_id': 'req-d6e7cc1f-2153-4239-83e7-632115885561'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.198372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9b739477fd4c7ca35e6f98f086dca9', 'request_id': 'req-d6e7cc1f-2153-4239-83e7-632115885561'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.210167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9b739477fd4c7ca35e6f98f086dca9', 'request_id': 'req-d6e7cc1f-2153-4239-83e7-632115885561'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.273509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a02e42fcffb4ff2a53cc89074ce117d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.280991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a02e42fcffb4ff2a53cc89074ce117d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.281757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a02e42fcffb4ff2a53cc89074ce117d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.282859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a02e42fcffb4ff2a53cc89074ce117d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.287039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] The token cache is being invalidate because project db9b739477fd4c7ca35e6f98f086dca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:00.291438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.291438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-d6e7cc1f-2153-4239-83e7-632115885561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.291438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1219/2490] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:59 2022] DELETE /identity/v3/projects/db9b739477fd4c7ca35e6f98f086dca9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:00.294683 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd371b-669e-4b89-9b43-4e88427ac369 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.294998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd371b-669e-4b89-9b43-4e88427ac369 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.295282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd371b-669e-4b89-9b43-4e88427ac369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.297400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-6de1d95c-32c7-4c8c-8016-d4a5e3313a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a02e42fcffb4ff2a53cc89074ce117d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:00.315974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-3dfd371b-669e-4b89-9b43-4e88427ac369 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:00.320172 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3dfd371b-669e-4b89-9b43-4e88427ac369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:00.377255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1272/2491] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:00 2022] DELETE /identity/v3/users/4a02e42fcffb4ff2a53cc89074ce117d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:00.380137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.380428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.380703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.383931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1220/2492] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:00.392797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41e2a-e06c-47d5-a825-357c30e38c8e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.393152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41e2a-e06c-47d5-a825-357c30e38c8e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.393384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41e2a-e06c-47d5-a825-357c30e38c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.410354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:00.410354 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:00.415086 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-fff41e2a-e06c-47d5-a825-357c30e38c8e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:00.416362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fff41e2a-e06c-47d5-a825-357c30e38c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:00.494446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1273/2493] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:00.501772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.504227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:00.504764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:00.517495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1221/2494] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:00.522676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41e2a-e06c-47d5-a825-357c30e38c8e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.532227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41e2a-e06c-47d5-a825-357c30e38c8e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.537451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.538118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.538405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.538734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.542510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:00.542510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.542510 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.558501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1222/2495] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:00.559448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.573597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d695a4-b3a2-48f3-95e4-06c7fb85811b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.578633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.579404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.579696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.580168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.580679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.583096 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.598547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8ab0-2ff7-48c5-b450-365ebcb28cd0 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.603995 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.605270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.605561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.605940 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.617782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.619373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.629941 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1274/2496] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:00.688945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1223/2497] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:00 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:00.690537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.703962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682db604-254c-4202-baba-dba9153a72c4 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.763232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:00.780248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.781488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.781773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.782054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.782742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.784772 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.876874 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1275/2498] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:00 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:00.878168 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.892052 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd136489-5052-46a8-9599-bd0b69eceae2 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.896820 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.897597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.897882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.898161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.898927 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.900641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.915720 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1224/2499] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:00.916953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.928704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f881ad-3261-475b-8cfe-99b317e639bc admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.933671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96075797-d4dd-4bbd-a254-14b9024c73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.934351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075797-d4dd-4bbd-a254-14b9024c73e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.934638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075797-d4dd-4bbd-a254-14b9024c73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.934958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075797-d4dd-4bbd-a254-14b9024c73e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.935721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96075797-d4dd-4bbd-a254-14b9024c73e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.937588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96075797-d4dd-4bbd-a254-14b9024c73e1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:00.948350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1276/2500] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:00.953023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:00.963262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01c153-1ae6-4cd4-a4b3-fc8619b0dbc5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:00.971093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:00.971816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:00.972103 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:00.972382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] PATH_INFO: `/v3/projects/a4dcd6b193e54872854a95e66ea1d29f/users/d46cec7a5c5d42309bb6863effeb2470/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:00.988610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4dcd6b193e54872854a95e66ea1d29f, user_id=d46cec7a5c5d42309bb6863effeb2470, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:00.991181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:01.128499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1225/2501] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:00 2022] PUT /identity/v3/projects/a4dcd6b193e54872854a95e66ea1d29f/users/d46cec7a5c5d42309bb6863effeb2470/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:01.137587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:01.137587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:01.137918 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:01.173715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] MFA Rules not processed for user `d46cec7a5c5d42309bb6863effeb2470`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:01.173715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:01.238704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1277/2502] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:01.243273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:01.295022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:01.295022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:01.338368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea658a-75fd-47e8-81d8-1fd04da2a7c6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:01.353595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:01.354281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:01.354568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:01.355131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:01.356000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:01.358039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:01.385795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bfb76-f9c4-4ed4-aad2-59ae37cfda5e None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:01.413903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:01.414785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:01.415099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:01.415374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] PATH_INFO: `/v3/projects/49e0b907a77b45bc9c80330a0531ce1e` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:01.416680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e0b907a77b45bc9c80330a0531ce1e)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:01.419142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:01.454855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1226/2503] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:01 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:01.456664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:01.525889 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a710c16-fed2-4767-9352-77f782f116a9 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:01.535748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:01.535748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:01.535748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:01.535748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:01.536119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:01.536119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:01.579207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e0b907a77b45bc9c80330a0531ce1e', 'request_id': 'req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:01.586717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e0b907a77b45bc9c80330a0531ce1e', 'request_id': 'req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:01.593361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e0b907a77b45bc9c80330a0531ce1e', 'request_id': 'req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:01.630645 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1227/2504] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:01 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:01.632192 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:01.647697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:01.655098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cc8ed-bd43-4a38-be0d-634d5143370a admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:01.712933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] The token cache is being invalidate because project 49e0b907a77b45bc9c80330a0531ce1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:01.713466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:01.714560 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:01.716212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1278/2505] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:01 2022] DELETE /identity/v3/projects/49e0b907a77b45bc9c80330a0531ce1e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:01.729602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:01.752656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:01.753360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:01.753647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:01.753928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:01.759421 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:01.762064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:01.791293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1228/2506] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:01.796014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:01.798634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:01.814939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251bb8e-59c9-41a4-92b0-2986a6bd21b1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:01.820301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:01.821551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:01.821928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:01.822141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] PATH_INFO: `/v3/projects/f27c4f206ecd4baf95c39955975b03cd/users/801a519186e2486c854f2cb585ba1431/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:01.845640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27c4f206ecd4baf95c39955975b03cd, user_id=801a519186e2486c854f2cb585ba1431, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:01.849259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:01.952829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1279/2507] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:01 2022] PUT /identity/v3/projects/f27c4f206ecd4baf95c39955975b03cd/users/801a519186e2486c854f2cb585ba1431/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:01.956891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:01.967211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc1724-f1b2-483d-b546-0c18f95ead03 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:02.026413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197622f5-dcae-48a2-b4fe-19d6d7484669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:02.027117 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197622f5-dcae-48a2-b4fe-19d6d7484669 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:02.027409 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197622f5-dcae-48a2-b4fe-19d6d7484669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:02.027690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197622f5-dcae-48a2-b4fe-19d6d7484669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:02.028418 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197622f5-dcae-48a2-b4fe-19d6d7484669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:02.030024 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197622f5-dcae-48a2-b4fe-19d6d7484669 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:02.042690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1229/2508] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:02.047151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:02.058944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab139f-d5ed-4f35-83ac-2f34945b38d7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:02.067631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:02.068823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:02.069134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:02.069401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] PATH_INFO: `/v3/projects/f27c4f206ecd4baf95c39955975b03cd/users/801a519186e2486c854f2cb585ba1431/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:02.072150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27c4f206ecd4baf95c39955975b03cd, user_id=801a519186e2486c854f2cb585ba1431, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:02.074549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:02.088191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1280/2509] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:02 2022] PUT /identity/v3/projects/f27c4f206ecd4baf95c39955975b03cd/users/801a519186e2486c854f2cb585ba1431/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:02.100018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba71b-ac96-4e1a-aa88-ff0a14acd616 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:02.100309 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba71b-ac96-4e1a-aa88-ff0a14acd616 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:02.100589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba71b-ac96-4e1a-aa88-ff0a14acd616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:02.129413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-dceba71b-ac96-4e1a-aa88-ff0a14acd616 None None] MFA Rules not processed for user `801a519186e2486c854f2cb585ba1431`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:02.130621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-dceba71b-ac96-4e1a-aa88-ff0a14acd616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:02.204980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1230/2510] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:02.216673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:02.219142 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:02.279820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a5269-1ffb-4ce9-824d-d8c413b8b539 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:02.284068 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac8996-6cb3-4b31-b136-7467cebe4a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:02.284792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8996-6cb3-4b31-b136-7467cebe4a53 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:02.285012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8996-6cb3-4b31-b136-7467cebe4a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:02.285291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8996-6cb3-4b31-b136-7467cebe4a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:02.299188 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac8996-6cb3-4b31-b136-7467cebe4a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:02.300679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac8996-6cb3-4b31-b136-7467cebe4a53 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:02.311931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1281/2511] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:02.557380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba71b-ac96-4e1a-aa88-ff0a14acd616 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:02.567261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba71b-ac96-4e1a-aa88-ff0a14acd616 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:02.570929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:02.571775 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:02.572247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:02.572531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:02.574397 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:02.596816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:02.634439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:02.635913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:02.645431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1231/2512] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:02.973887 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:02.974172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:02.974448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:02.992181 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:02.993373 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:03.052517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1282/2513] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 22 09:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:03.066985 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:03.068374 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:03.147436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0fdd4-a34c-41ab-8e9d-a0804ae4aab6 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:03.152403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:03.153056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:03.153338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:03.153739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:03.162237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:03.163917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:03.172498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1232/2514] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:15:03.185138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:03.186754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:03.245080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfdaf8-1459-4ba8-9af1-0a5d6d229a23 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:03.248978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:03.250223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:03.250525 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:03.250805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:03.252611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:03.261808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:03.321579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:03.321579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:03.329631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1283/2515] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:08.408489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:08.409935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:08.425787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f25e83-96a1-4433-9151-a01f503dcc3e service swift] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:08.434029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:08.434029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:08.434029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:08.434029 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] PATH_INFO: `/v3/users/0673a8903f56430f86f87b9447668300` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:08.434364 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0673a8903f56430f86f87b9447668300)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:08.436189 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:08.681748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0673a8903f56430f86f87b9447668300'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.763412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0673a8903f56430f86f87b9447668300'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.772233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0673a8903f56430f86f87b9447668300'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.773152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0673a8903f56430f86f87b9447668300'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.773890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1e844c63-25d8-46c9-9386-20f65e5ca1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0673a8903f56430f86f87b9447668300'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.798609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1233/2516] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:08 2022] DELETE /identity/v3/users/0673a8903f56430f86f87b9447668300 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:09.031321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.043178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9508b-9286-4978-b2fb-b92d205ba85c service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.109610 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.110471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.110751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.111054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] PATH_INFO: `/v3/projects/dfcacaecd4564e90bfc76ff7e77911da` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.112305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcacaecd4564e90bfc76ff7e77911da)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.114150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:09.218666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcacaecd4564e90bfc76ff7e77911da', 'request_id': 'req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.224889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcacaecd4564e90bfc76ff7e77911da', 'request_id': 'req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.230812 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcacaecd4564e90bfc76ff7e77911da', 'request_id': 'req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.346313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] The token cache is being invalidate because project dfcacaecd4564e90bfc76ff7e77911da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:09.352554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.352708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8a2c5f36-a0df-4bec-9941-2a2e86dc0bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.360387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1284/2517] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:09 2022] DELETE /identity/v3/projects/dfcacaecd4564e90bfc76ff7e77911da => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:09.365577 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54ea4-eb82-4cc1-86ff-ba75f272e8fb None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.374992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54ea4-eb82-4cc1-86ff-ba75f272e8fb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.374992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54ea4-eb82-4cc1-86ff-ba75f272e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.385371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-33f54ea4-eb82-4cc1-86ff-ba75f272e8fb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:09.386579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-33f54ea4-eb82-4cc1-86ff-ba75f272e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:09.404412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:09.459092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1234/2518] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:09.466590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbaca3-9e3f-473e-8805-fab444fe08c7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.467152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbaca3-9e3f-473e-8805-fab444fe08c7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.467439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbaca3-9e3f-473e-8805-fab444fe08c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.489556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-d6dbaca3-9e3f-473e-8805-fab444fe08c7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:09.491266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d6dbaca3-9e3f-473e-8805-fab444fe08c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:09.500318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1285/2519] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:09.504917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54ea4-eb82-4cc1-86ff-ba75f272e8fb None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.516504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54ea4-eb82-4cc1-86ff-ba75f272e8fb None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.521713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.522371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.522734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.523197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.523920 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:09.524226 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.525818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:09.542089 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1235/2520] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:15:09.545958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbaca3-9e3f-473e-8805-fab444fe08c7 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.562702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbaca3-9e3f-473e-8805-fab444fe08c7 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.575676 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.576361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.576650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.576930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.578247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.580217 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:09.693359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1286/2521] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:09 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:09.696470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.709140 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06786645-3649-44cd-9d0b-dc287596bff9 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.775758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.776348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.776634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.776910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.777606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.779695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:09.876496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1236/2522] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:09 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:09.877707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.888134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78815d37-8834-4a9e-81b7-dd81fe5f08be admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.894629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.899686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.899686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.899686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.899686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.900609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:09.902344 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:09.912782 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1287/2523] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:09.916469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.927351 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85335ab-8568-4889-a43c-731fae8f2f02 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.932462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.933153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.933439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.933747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.934474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.936182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:09.947701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1237/2524] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:09.951566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.962618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a7546-fa8d-4f59-aa83-c6b32bd3d0ae admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.972519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00f9a8-5a2b-40da-9c70-2562b6c8229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.973826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00f9a8-5a2b-40da-9c70-2562b6c8229b admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.974263 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00f9a8-5a2b-40da-9c70-2562b6c8229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.974710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00f9a8-5a2b-40da-9c70-2562b6c8229b admin admin] PATH_INFO: `/v3/projects/af1d6c5e5dd94cb7bc39469855ce522d/users/6ad3ff4afc3b4a63859f832645df15f5/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.996203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00f9a8-5a2b-40da-9c70-2562b6c8229b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1d6c5e5dd94cb7bc39469855ce522d, user_id=6ad3ff4afc3b4a63859f832645df15f5, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.998951 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00f9a8-5a2b-40da-9c70-2562b6c8229b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.108965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1288/2525] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:09 2022] PUT /identity/v3/projects/af1d6c5e5dd94cb7bc39469855ce522d/users/6ad3ff4afc3b4a63859f832645df15f5/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:10.114507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.116500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.126450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.131362 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.131649 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.158558 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] MFA Rules not processed for user `6ad3ff4afc3b4a63859f832645df15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:10.160160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.203801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb8608-fa3a-4a1a-9993-750230628261 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.240695 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1289/2526] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:10.251879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:10.257406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.266390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.266499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.267833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.268196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.268561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.271713 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.411885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.414350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.429078 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1238/2527] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:10.449183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfac1d-8058-49d6-8dd1-53cb6f6b27ca None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.457430 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.458332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.458933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.459364 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.471843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.474000 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.488837 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1290/2528] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:13.438809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:13.440371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:13.518008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b923f9-adc4-42e7-b240-ac89befa430a service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:13.525813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:13.527017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:13.527314 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:13.527597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] PATH_INFO: `/v3/users/4d6a812133cf437fa3e13f56d1cddd53` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:13.530094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6a812133cf437fa3e13f56d1cddd53)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:13.532850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:13.732108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6a812133cf437fa3e13f56d1cddd53'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:13.814516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6a812133cf437fa3e13f56d1cddd53'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:13.822534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6a812133cf437fa3e13f56d1cddd53'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:13.823201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6a812133cf437fa3e13f56d1cddd53'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:13.823809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6a812133cf437fa3e13f56d1cddd53'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:13.841924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1239/2529] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:13 2022] DELETE /identity/v3/users/4d6a812133cf437fa3e13f56d1cddd53 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:14.006211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:14.013113 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5f69-10dc-475f-ba9d-b37dc51fcb8e service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:14.064659 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:14.080494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:14.081736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:14.082028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:14.082305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] PATH_INFO: `/v3/users/6ad3ff4afc3b4a63859f832645df15f5` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:14.084124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad3ff4afc3b4a63859f832645df15f5)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:14.085794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:14.309560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:14.312341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:14.315886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad3ff4afc3b4a63859f832645df15f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.325442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad3ff4afc3b4a63859f832645df15f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.326293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad3ff4afc3b4a63859f832645df15f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.327866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad3ff4afc3b4a63859f832645df15f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.342037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-addfc755-42cb-4700-ad3f-4f61b9861dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad3ff4afc3b4a63859f832645df15f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.393305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3aec-ec3c-4376-bafa-93286b9781e7 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:14.407617 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:14.419077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:14.419376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:14.419669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] PATH_INFO: `/v3/projects/476725d6c5c44caebdd8d8e855cc63c6` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:14.422667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476725d6c5c44caebdd8d8e855cc63c6)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:14.424975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:14.438993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:14.465238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1291/2530] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:13 2022] DELETE /identity/v3/users/6ad3ff4afc3b4a63859f832645df15f5 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:14.469633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:14.469921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:14.470197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:14.488377 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:14.489591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:14.548229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1292/2531] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:14.557682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:14.559105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:14.575446 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476725d6c5c44caebdd8d8e855cc63c6', 'request_id': 'req-f6dba0d4-279f-44b2-a982-03122ca936e6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.585843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476725d6c5c44caebdd8d8e855cc63c6', 'request_id': 'req-f6dba0d4-279f-44b2-a982-03122ca936e6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.602051 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476725d6c5c44caebdd8d8e855cc63c6', 'request_id': 'req-f6dba0d4-279f-44b2-a982-03122ca936e6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.657710 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4262f-e18b-45b2-93b8-c25be2885824 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:14.677468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:14.705875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] The token cache is being invalidate because project 476725d6c5c44caebdd8d8e855cc63c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:14.706426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.709179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:14.709179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1240/2532] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:14 2022] DELETE /identity/v3/projects/476725d6c5c44caebdd8d8e855cc63c6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:14.709820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:14.710477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:14.710767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:14.711076 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:14.712641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:14.713183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:14.717520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:14.796906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:14.798529 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:14.813937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba0d4-279f-44b2-a982-03122ca936e6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:14.814394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1293/2533] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:14.815802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:14.817707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:14.818513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:14.819676 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:14.820120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:14.820624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] PATH_INFO: `/v3/users/fe5899b38e9d40d28ae0ad2b01dd15a5` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:14.822204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5899b38e9d40d28ae0ad2b01dd15a5)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:14.824289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:14.839840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102e67-5800-4bc7-abde-c746762982f3 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:14.847582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:14.848586 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:14.849085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:14.849444 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] PATH_INFO: `/v3/users/d46cec7a5c5d42309bb6863effeb2470` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:14.852159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46cec7a5c5d42309bb6863effeb2470)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:14.854385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:15.380871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5899b38e9d40d28ae0ad2b01dd15a5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.444938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46cec7a5c5d42309bb6863effeb2470'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.452847 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46cec7a5c5d42309bb6863effeb2470'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.456211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5899b38e9d40d28ae0ad2b01dd15a5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.456712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46cec7a5c5d42309bb6863effeb2470'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.456712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46cec7a5c5d42309bb6863effeb2470'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.463502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5899b38e9d40d28ae0ad2b01dd15a5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.464556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5899b38e9d40d28ae0ad2b01dd15a5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.465239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-eb175242-ce41-4412-9eaa-df7dc1ad354d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5899b38e9d40d28ae0ad2b01dd15a5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.474084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46cec7a5c5d42309bb6863effeb2470'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.485288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1241/2534] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:14 2022] DELETE /identity/v3/users/fe5899b38e9d40d28ae0ad2b01dd15a5 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:15.550447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1294/2535] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:14 2022] DELETE /identity/v3/users/d46cec7a5c5d42309bb6863effeb2470 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:15.555382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.555675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.556002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:15.574655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:15.576780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:15.590481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:15.620957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:15.622758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:15.656291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1242/2536] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:15.680550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:15.681964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:15.700398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:15.720456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33ec02-dc15-4056-b5fc-8ee345fda48e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:15.725744 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:15.726620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.726938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.727216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] PATH_INFO: `/v3/projects/af1d6c5e5dd94cb7bc39469855ce522d` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:15.728405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1d6c5e5dd94cb7bc39469855ce522d)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:15.730630 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:15.769810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a944064-3bd0-4f79-882d-3be2c5a3f018 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:15.775788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:15.776544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.776829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.777107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:15.787666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:15.789113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:15.799729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1243/2537] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:15.800580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:15.801925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:15.815759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb5dc6-0527-4be5-ad25-c5ec5ab1cc30 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:15.820786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:15.821638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.821921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.822203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] PATH_INFO: `/v3/projects/ab7a6f50e1844d37a3b215d4fedf4621` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:15.823459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7a6f50e1844d37a3b215d4fedf4621)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:15.825974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:15.886593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1d6c5e5dd94cb7bc39469855ce522d', 'request_id': 'req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.894160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1d6c5e5dd94cb7bc39469855ce522d', 'request_id': 'req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.900236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1d6c5e5dd94cb7bc39469855ce522d', 'request_id': 'req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.962307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7a6f50e1844d37a3b215d4fedf4621', 'request_id': 'req-1801e225-ea70-4e05-863a-0210db254e0c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.968316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7a6f50e1844d37a3b215d4fedf4621', 'request_id': 'req-1801e225-ea70-4e05-863a-0210db254e0c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.974349 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7a6f50e1844d37a3b215d4fedf4621', 'request_id': 'req-1801e225-ea70-4e05-863a-0210db254e0c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.980926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] The token cache is being invalidate because project af1d6c5e5dd94cb7bc39469855ce522d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:15.985159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.985159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a9ead9b5-e67b-43d0-97f4-8aff06711ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.985159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1295/2538] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:15 2022] DELETE /identity/v3/projects/af1d6c5e5dd94cb7bc39469855ce522d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:15.989168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b554-3d9c-4995-8097-613ff8d313cd None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.989400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b554-3d9c-4995-8097-613ff8d313cd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.990862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b554-3d9c-4995-8097-613ff8d313cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.010433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6817b554-3d9c-4995-8097-613ff8d313cd None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:16.011755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6817b554-3d9c-4995-8097-613ff8d313cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:16.077441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] The token cache is being invalidate because project ab7a6f50e1844d37a3b215d4fedf4621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:16.077821 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.078471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1801e225-ea70-4e05-863a-0210db254e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.080824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1244/2539] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:15 2022] DELETE /identity/v3/projects/ab7a6f50e1844d37a3b215d4fedf4621 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:16.088372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1296/2540] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:16.101926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc7fc-473c-4031-b419-3c10f4347903 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.102561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc7fc-473c-4031-b419-3c10f4347903 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.102959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cc7fc-473c-4031-b419-3c10f4347903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.127938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-024cc7fc-473c-4031-b419-3c10f4347903 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:16.129501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-024cc7fc-473c-4031-b419-3c10f4347903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:16.139532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1245/2541] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:16.143429 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b554-3d9c-4995-8097-613ff8d313cd None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.166248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b554-3d9c-4995-8097-613ff8d313cd None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.172378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.173119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.174015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.174295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.175163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:16.177522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.177522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.197680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1297/2542] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:16.202383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cc7fc-473c-4031-b419-3c10f4347903 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.212415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cc7fc-473c-4031-b419-3c10f4347903 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.217386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.218124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.218411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.218692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.219515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.221629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.262130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.264016 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:16.283704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4af1eb-6ced-4b4f-bf7e-dfb251919448 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.290553 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.292296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.292686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.292822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] PATH_INFO: `/v3/projects/a4dcd6b193e54872854a95e66ea1d29f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.294198 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4dcd6b193e54872854a95e66ea1d29f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.297136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.342281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1246/2543] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:16 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:16.346787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.367928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:16.410457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee25df-c89a-4fdb-9fa7-b34aead25b0b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.416404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.417076 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.417788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.417788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.419049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.421820 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.440290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4dcd6b193e54872854a95e66ea1d29f', 'request_id': 'req-ec2a666c-fbe5-425c-91fc-9f01561c133e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.446993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4dcd6b193e54872854a95e66ea1d29f', 'request_id': 'req-ec2a666c-fbe5-425c-91fc-9f01561c133e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.452997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4dcd6b193e54872854a95e66ea1d29f', 'request_id': 'req-ec2a666c-fbe5-425c-91fc-9f01561c133e'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.506228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:16.569541 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] The token cache is being invalidate because project a4dcd6b193e54872854a95e66ea1d29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:16.569836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.570132 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1247/2544] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:16 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:16.570629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.572466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1298/2545] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:16 2022] DELETE /identity/v3/projects/a4dcd6b193e54872854a95e66ea1d29f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:16.574479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.576023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.576539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:16.577431 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:16.589592 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc893-fb56-4e3a-aecf-cdf95dd17377 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.644640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a666c-fbe5-425c-91fc-9f01561c133e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.653301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.653301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.653301 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.653680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.653790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.653879 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.653964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.654057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.654057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] PATH_INFO: `/v3/users/801a519186e2486c854f2cb585ba1431` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.654210 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.654293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] RBAC: Authorizing `identity:delete_user(user_id=801a519186e2486c854f2cb585ba1431)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.654293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.662449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1248/2546] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:16.666578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.676493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206291-cb7d-4805-b767-27d64b76930a admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.681239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.681991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.682282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.682560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.683331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.684945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.694871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1249/2547] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:16.699067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.709083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8fa80-e8f6-4e7d-af26-860ac29a3b15 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.713710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d583a-5958-45fb-a07f-40f9ec89343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.714563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d583a-5958-45fb-a07f-40f9ec89343f admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.714871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d583a-5958-45fb-a07f-40f9ec89343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.715152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d583a-5958-45fb-a07f-40f9ec89343f admin admin] PATH_INFO: `/v3/projects/91361ce05ac44b308cc23a658cbfc221/users/617384eba556402c9b8a970f2012917d/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.730569 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d583a-5958-45fb-a07f-40f9ec89343f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91361ce05ac44b308cc23a658cbfc221, user_id=617384eba556402c9b8a970f2012917d, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.733293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d583a-5958-45fb-a07f-40f9ec89343f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.817185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1250/2548] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:16 2022] PUT /identity/v3/projects/91361ce05ac44b308cc23a658cbfc221/users/617384eba556402c9b8a970f2012917d/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:16.828695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.828984 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.829858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.856621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] MFA Rules not processed for user `617384eba556402c9b8a970f2012917d`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:16.857917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:16.880383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801a519186e2486c854f2cb585ba1431'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.888408 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801a519186e2486c854f2cb585ba1431'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.889316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801a519186e2486c854f2cb585ba1431'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.890633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801a519186e2486c854f2cb585ba1431'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.907161 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801a519186e2486c854f2cb585ba1431'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.927970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1251/2549] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:16.939288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.940840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:16.997111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1299/2550] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:16 2022] DELETE /identity/v3/users/801a519186e2486c854f2cb585ba1431 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:17.015538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825df89b-af8e-4287-b225-1fa7b87307e1 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.087616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.088273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.088559 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.088838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.143613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.145228 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.154200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1252/2551] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:17.176495 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.177910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.251290 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:17.268267 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66488dda-e3f1-42a3-94b7-509fe63d289a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.273043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.274802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.274802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.275042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.276927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.312165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:17.369687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.371251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.383224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1300/2552] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:17.421913 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.423894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.437804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d61f7-eb2e-4b1f-a67b-5c6c56e93910 service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.442585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.443570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.443919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.444277 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] PATH_INFO: `/v3/users/617384eba556402c9b8a970f2012917d` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.445555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617384eba556402c9b8a970f2012917d)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.447570 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.479278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.485324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.494281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d2e62-f257-49fe-b0de-85f06a304df6 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.499771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.500724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.501012 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.501302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] PATH_INFO: `/v3/projects/f27c4f206ecd4baf95c39955975b03cd` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.502986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27c4f206ecd4baf95c39955975b03cd)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.505337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.536739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:17.635354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617384eba556402c9b8a970f2012917d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.636043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27c4f206ecd4baf95c39955975b03cd', 'request_id': 'req-7330d75c-326c-4834-a0e4-2dc9280e4ab4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.642385 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27c4f206ecd4baf95c39955975b03cd', 'request_id': 'req-7330d75c-326c-4834-a0e4-2dc9280e4ab4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.648219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27c4f206ecd4baf95c39955975b03cd', 'request_id': 'req-7330d75c-326c-4834-a0e4-2dc9280e4ab4'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.751689 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617384eba556402c9b8a970f2012917d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.759490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617384eba556402c9b8a970f2012917d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.760305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617384eba556402c9b8a970f2012917d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.760909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-31cb07ad-5d6d-4c60-8d4c-f65f8010be49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617384eba556402c9b8a970f2012917d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.778908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1253/2553] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:17 2022] DELETE /identity/v3/users/617384eba556402c9b8a970f2012917d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:17.783840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.784130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.784416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.803234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:17.804434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.848717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] The token cache is being invalidate because project f27c4f206ecd4baf95c39955975b03cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:17.849160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.849885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7330d75c-326c-4834-a0e4-2dc9280e4ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.851829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1301/2554] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:17 2022] DELETE /identity/v3/projects/f27c4f206ecd4baf95c39955975b03cd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:17.856919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757cdb3-52cf-4be3-8b48-fc44235d60a7 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.857215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757cdb3-52cf-4be3-8b48-fc44235d60a7 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.857503 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757cdb3-52cf-4be3-8b48-fc44235d60a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.868077 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1254/2555] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:17.877698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.879297 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.882651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a757cdb3-52cf-4be3-8b48-fc44235d60a7 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:17.883877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a757cdb3-52cf-4be3-8b48-fc44235d60a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.892296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1302/2556] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:17.900200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b4e8-f039-4749-b629-e7617daf7cbd None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.900496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b4e8-f039-4749-b629-e7617daf7cbd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.900779 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b4e8-f039-4749-b629-e7617daf7cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.919324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6769b4e8-f039-4749-b629-e7617daf7cbd None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:17.920572 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6769b4e8-f039-4749-b629-e7617daf7cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.929483 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1303/2557] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:17.933669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769b4e8-f039-4749-b629-e7617daf7cbd None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.942296 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822744-301c-4bed-a065-f2d495f84564 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.942979 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769b4e8-f039-4749-b629-e7617daf7cbd None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.947443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.948204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.948463 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.948849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.948946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.949130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.949407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.949573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.950203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:17.950441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.953441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.960214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.961656 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.969091 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1304/2558] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:17.970223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.976350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1255/2559] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:17.986978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8f719-af8b-434b-946e-8109e8b48c91 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.992073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.992941 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.993214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.993489 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.994390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.996846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.090858 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1305/2560] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:18.095387 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.106084 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732673f-4e50-4f73-8505-b91f5964e1e8 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.152746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:18.165487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.166200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.166491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.166769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.167496 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.169481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.267571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1256/2561] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:18.271656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.291579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448cd7-7bed-4572-9fd2-ac6c14a94928 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.297153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.297865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.298278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.298568 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.299515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.301105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.315511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1306/2562] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:18.316987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.329001 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470645-357c-41bc-b92b-322b08ecaff8 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.336458 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.337162 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.337624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.338090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.338967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.340988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.356404 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1257/2563] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:18.360993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.373811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf701f-d64f-4dd6-89d2-4b7a2fee72c4 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.381443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321d38b-b55f-470f-bb7e-d2101f097679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.382464 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d38b-b55f-470f-bb7e-d2101f097679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.382747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d38b-b55f-470f-bb7e-d2101f097679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.383112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d38b-b55f-470f-bb7e-d2101f097679 admin admin] PATH_INFO: `/v3/projects/54ce102f434341cbbae10a0e90b453c7/users/d0445688726d414aa76f39a1201b30e1/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.413135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321d38b-b55f-470f-bb7e-d2101f097679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ce102f434341cbbae10a0e90b453c7, user_id=d0445688726d414aa76f39a1201b30e1, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.415866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321d38b-b55f-470f-bb7e-d2101f097679 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.481909 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.484416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.506613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1307/2564] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:18 2022] PUT /identity/v3/projects/54ce102f434341cbbae10a0e90b453c7/users/d0445688726d414aa76f39a1201b30e1/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:18.516851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f97be-7433-4b79-a441-0a69c713e339 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.517359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f97be-7433-4b79-a441-0a69c713e339 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.518108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f97be-7433-4b79-a441-0a69c713e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.522922 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64a852-409c-4e82-bf02-8532463bb334 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.559426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:18.564749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-638f97be-7433-4b79-a441-0a69c713e339 None None] MFA Rules not processed for user `d0445688726d414aa76f39a1201b30e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:18.566238 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-638f97be-7433-4b79-a441-0a69c713e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.588692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.589615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.589967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.590330 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] PATH_INFO: `/v3/projects/91361ce05ac44b308cc23a658cbfc221` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.591680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=91361ce05ac44b308cc23a658cbfc221)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.593703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.643574 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1308/2565] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:18.648023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f97be-7433-4b79-a441-0a69c713e339 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.658760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f97be-7433-4b79-a441-0a69c713e339 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.663285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.663952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.664320 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.664636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.665322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.667234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.729884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91361ce05ac44b308cc23a658cbfc221', 'request_id': 'req-7a9df3b4-d0cf-4430-b126-927486498dca'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.736481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91361ce05ac44b308cc23a658cbfc221', 'request_id': 'req-7a9df3b4-d0cf-4430-b126-927486498dca'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.742120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91361ce05ac44b308cc23a658cbfc221', 'request_id': 'req-7a9df3b4-d0cf-4430-b126-927486498dca'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.781893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1309/2566] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:18.785682 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.830558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] The token cache is being invalidate because project 91361ce05ac44b308cc23a658cbfc221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:18.832190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.832190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-7a9df3b4-d0cf-4430-b126-927486498dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.833620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1258/2567] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:18 2022] DELETE /identity/v3/projects/91361ce05ac44b308cc23a658cbfc221 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:18.838318 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6377bc-1fc7-4e36-9398-c6fe1c9a7edd None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.838685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6377bc-1fc7-4e36-9398-c6fe1c9a7edd None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.839067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6377bc-1fc7-4e36-9398-c6fe1c9a7edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.852245 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a30f29-06c5-4af2-a9e3-dbeeaaa6c5e9 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.857684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.859062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.859062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.859062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.859692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.861774 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.862416 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-7e6377bc-1fc7-4e36-9398-c6fe1c9a7edd None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:18.864003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7e6377bc-1fc7-4e36-9398-c6fe1c9a7edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.876088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1259/2568] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:18.885180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7dab-be50-4ecc-a0f1-22366dfa0885 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.886841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7dab-be50-4ecc-a0f1-22366dfa0885 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.886841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7dab-be50-4ecc-a0f1-22366dfa0885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.908241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-bd9e7dab-be50-4ecc-a0f1-22366dfa0885 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:18.909857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bd9e7dab-be50-4ecc-a0f1-22366dfa0885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.922848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1260/2569] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:18.923815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e7dab-be50-4ecc-a0f1-22366dfa0885 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.933583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e7dab-be50-4ecc-a0f1-22366dfa0885 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.939858 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.940786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.941146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.942515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.942515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:18.942515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.944359 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.947479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1310/2570] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:18.951633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.955388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.964144 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1261/2571] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:18.969045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.978742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfca30b-4ec4-4697-89d9-b92af00b81cb admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.984489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6f3e3-fcd0-4eb6-a3ba-a7e0215737bd admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.985160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.985961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.986357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.986885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.987906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.989686 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.991679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.992729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.993175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.993621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.995182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.998356 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.003046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1311/2572] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:19.007196 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.019567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc787bd5-4402-4b1e-a2ef-fe6de17fb927 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.025589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.026801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.030159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.030159 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] PATH_INFO: `/v3/projects/ab97625c003c4179941d697677a1e3bb/users/9c3cf409ddf14d438858596d135074a3/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.046358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab97625c003c4179941d697677a1e3bb, user_id=9c3cf409ddf14d438858596d135074a3, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.049346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.085369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1262/2573] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:19.089125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.101031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:19.114360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1312/2574] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:19 2022] PUT /identity/v3/projects/ab97625c003c4179941d697677a1e3bb/users/9c3cf409ddf14d438858596d135074a3/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:19.118237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.155445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc862-b478-4708-83ee-db6a1efa362d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.162640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:19.198145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe14b9-b4ac-48b6-abf5-f9ac06b19425 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.206023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.206868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.207244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.207620 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.208456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.213646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.228985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1313/2575] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:19.232166 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.232870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.233668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.233959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.234921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.237721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.238599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.252215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40848-2a78-4271-b171-f24f10b4a67c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.259234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20048bff-74be-49b2-a141-346142950198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.260493 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048bff-74be-49b2-a141-346142950198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.260783 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048bff-74be-49b2-a141-346142950198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.261121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048bff-74be-49b2-a141-346142950198 admin admin] PATH_INFO: `/v3/projects/ab97625c003c4179941d697677a1e3bb/users/9c3cf409ddf14d438858596d135074a3/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.263501 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20048bff-74be-49b2-a141-346142950198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab97625c003c4179941d697677a1e3bb, user_id=9c3cf409ddf14d438858596d135074a3, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.266272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20048bff-74be-49b2-a141-346142950198 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.277823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1314/2576] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:19 2022] PUT /identity/v3/projects/ab97625c003c4179941d697677a1e3bb/users/9c3cf409ddf14d438858596d135074a3/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:19.289275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.289613 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.290264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.324083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] MFA Rules not processed for user `9c3cf409ddf14d438858596d135074a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:19.325311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:19.329761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1263/2577] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:19.333573 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.345417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f990d-6aa5-44a7-9361-ddb1b479c3b3 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.447428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.448043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.448325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.448602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.449527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1315/2578] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:19.453420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.458006 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.463174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.465228 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:19.469813 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1264/2579] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:19.474614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.488769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2d82-fa74-4481-93f0-f345aa747157 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.493655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.494378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.494668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.494995 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.495870 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.497631 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.509373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1265/2580] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:19.513155 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.534147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b999dcf-3c43-4d88-bff5-8f38d7dd685d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.544698 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.545646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.546513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.546797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] PATH_INFO: `/v3/projects/e1aa6de2357f4de199c7f85cb4357fd5/users/b9fcc06c61104ec3b82a07d3218aa499/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.551321 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511d4a-88e5-4678-a833-2ff12c8a4a55 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.564602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1aa6de2357f4de199c7f85cb4357fd5, user_id=b9fcc06c61104ec3b82a07d3218aa499, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.564763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667dca3-390c-4592-9d02-dbd1f223b795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.568549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667dca3-390c-4592-9d02-dbd1f223b795 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.568549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667dca3-390c-4592-9d02-dbd1f223b795 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.568549 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667dca3-390c-4592-9d02-dbd1f223b795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.568836 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.582547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667dca3-390c-4592-9d02-dbd1f223b795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.583919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667dca3-390c-4592-9d02-dbd1f223b795 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.601631 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1316/2581] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:19.655092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1266/2582] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:19 2022] PUT /identity/v3/projects/e1aa6de2357f4de199c7f85cb4357fd5/users/b9fcc06c61104ec3b82a07d3218aa499/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:19.666023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2355e-e5c3-48bb-9a8c-eba41d853b55 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.666407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2355e-e5c3-48bb-9a8c-eba41d853b55 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.666696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2355e-e5c3-48bb-9a8c-eba41d853b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.705498 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2cf2355e-e5c3-48bb-9a8c-eba41d853b55 None None] MFA Rules not processed for user `b9fcc06c61104ec3b82a07d3218aa499`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:19.706998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2cf2355e-e5c3-48bb-9a8c-eba41d853b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:19.745137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:19.776254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1317/2583] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:19.781557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.791308 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:19.869647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aabc6-d546-454b-bba0-9baac7115154 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.874216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.874902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.875187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.875464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.876156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.878053 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.998342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1267/2584] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:20.002371 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2355e-e5c3-48bb-9a8c-eba41d853b55 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.015492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2355e-e5c3-48bb-9a8c-eba41d853b55 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.113120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.113895 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.114271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.114645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.115481 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.118230 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.227561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1318/2585] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:20 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:20.229178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.240267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d86cd8-fd77-42ca-bd1c-973e5a8af9cd admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.247724 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.248452 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.248687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.249469 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.250188 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.252730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.254409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:20.259563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.281912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1268/2586] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:20.286050 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.297892 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd9fb0-ea34-418a-a5dd-1b25aae6c270 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.304606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.313410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.313410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.313410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] PATH_INFO: `/v3/projects/7d8456b992804c78a7861c9e6fa9b350/users/6ce3618b442e4d71a23ae5846287d848/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.351554 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8456b992804c78a7861c9e6fa9b350, user_id=6ce3618b442e4d71a23ae5846287d848, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.354187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.381632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d287fe-9e8e-4dc3-928a-a25111e05adc admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.410285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.413027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.413358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.413646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.422272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:20.441186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.442897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.457073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1319/2587] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:20.461502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1269/2588] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:20 2022] PUT /identity/v3/projects/7d8456b992804c78a7861c9e6fa9b350/users/6ce3618b442e4d71a23ae5846287d848/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:20.465437 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.484134 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcb73f-21ee-4194-a398-e2fea36ab579 service placement] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.563566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:20.573502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410bb04-4881-497b-99fb-b553565d1f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.573502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410bb04-4881-497b-99fb-b553565d1f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.573975 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410bb04-4881-497b-99fb-b553565d1f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.574462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410bb04-4881-497b-99fb-b553565d1f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.575275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410bb04-4881-497b-99fb-b553565d1f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.577174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410bb04-4881-497b-99fb-b553565d1f00 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.587621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1320/2589] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:20.596513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.609039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8595b-3ff9-4f97-90ef-08594f8e5d04 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.614146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.615149 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.615433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.615911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] PATH_INFO: `/v3/projects/7d8456b992804c78a7861c9e6fa9b350/users/6ce3618b442e4d71a23ae5846287d848/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.618282 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8456b992804c78a7861c9e6fa9b350, user_id=6ce3618b442e4d71a23ae5846287d848, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.621928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.636839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1270/2590] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:20 2022] PUT /identity/v3/projects/7d8456b992804c78a7861c9e6fa9b350/users/6ce3618b442e4d71a23ae5846287d848/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:20.647689 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e9ed8-2546-4965-a96a-b487e716ccb3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.647986 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e9ed8-2546-4965-a96a-b487e716ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.648273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e9ed8-2546-4965-a96a-b487e716ccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.679694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-713e9ed8-2546-4965-a96a-b487e716ccb3 None None] MFA Rules not processed for user `6ce3618b442e4d71a23ae5846287d848`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:20.681352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-713e9ed8-2546-4965-a96a-b487e716ccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:20.694910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.779362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf18da-a273-4734-9fe0-d6582e329f18 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.785761 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1321/2591] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:20.786406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.787142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.787498 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.787847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] PATH_INFO: `/v3/users/d0445688726d414aa76f39a1201b30e1` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.789487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0445688726d414aa76f39a1201b30e1)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.791493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.793520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e9ed8-2546-4965-a96a-b487e716ccb3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.855460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e9ed8-2546-4965-a96a-b487e716ccb3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.859305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44327bcc-ae24-457a-9a02-3c0e904e7351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.860019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327bcc-ae24-457a-9a02-3c0e904e7351 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.863696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327bcc-ae24-457a-9a02-3c0e904e7351 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.863696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327bcc-ae24-457a-9a02-3c0e904e7351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.933999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44327bcc-ae24-457a-9a02-3c0e904e7351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.935479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44327bcc-ae24-457a-9a02-3c0e904e7351 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.944878 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1322/2592] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:21.012010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:21.013637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0445688726d414aa76f39a1201b30e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:21.128624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0445688726d414aa76f39a1201b30e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:21.136515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0445688726d414aa76f39a1201b30e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:21.137303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0445688726d414aa76f39a1201b30e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:21.137998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0445688726d414aa76f39a1201b30e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:21.157897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1271/2593] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:20 2022] DELETE /identity/v3/users/d0445688726d414aa76f39a1201b30e1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:21.162742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:21.163060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:21.163337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:21.182326 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:21.183596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:21.212803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:21.250612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1323/2594] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:21.260493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:21.261947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:21.321891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fcd79-7db8-4817-923a-88b4882e73b0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:21.326371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:21.327094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:21.327537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:21.327853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:21.337961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:21.339547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:21.349749 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1272/2595] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:21.936494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:21.938200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:21.953999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831f36b-9ce1-4189-8880-be9d0f1f7c95 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:21.959276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:21.960222 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:21.960487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:21.960822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] PATH_INFO: `/v3/projects/54ce102f434341cbbae10a0e90b453c7` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:21.962737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ce102f434341cbbae10a0e90b453c7)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:21.964739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:22.088609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ce102f434341cbbae10a0e90b453c7', 'request_id': 'req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.095528 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ce102f434341cbbae10a0e90b453c7', 'request_id': 'req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.101545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ce102f434341cbbae10a0e90b453c7', 'request_id': 'req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.179199 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] The token cache is being invalidate because project 54ce102f434341cbbae10a0e90b453c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:22.179492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.180147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.182004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1324/2596] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:21 2022] DELETE /identity/v3/projects/54ce102f434341cbbae10a0e90b453c7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:22.186131 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:22.196048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dc389-9fe6-44c4-b3df-93579a1efb20 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:22.256732 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:22.257593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:22.257884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:22.258160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] PATH_INFO: `/v3/users/9c3cf409ddf14d438858596d135074a3` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:22.259451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3cf409ddf14d438858596d135074a3)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:22.261513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:22.445551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3cf409ddf14d438858596d135074a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.505972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3cf409ddf14d438858596d135074a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.515476 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3cf409ddf14d438858596d135074a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.516204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3cf409ddf14d438858596d135074a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.516802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-3b927229-d840-4160-93b4-b9507bf82dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3cf409ddf14d438858596d135074a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:22.522369 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:22.546739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1273/2597] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:22 2022] DELETE /identity/v3/users/9c3cf409ddf14d438858596d135074a3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:23.153885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:23.156022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:23.177598 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbace23f-94c2-4ae0-bbc8-e4f5b1e6d96d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:23.255989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:23.256869 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:23.257297 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:23.257652 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] PATH_INFO: `/v3/projects/ab97625c003c4179941d697677a1e3bb` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:23.259370 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab97625c003c4179941d697677a1e3bb)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:23.261449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:23.397567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab97625c003c4179941d697677a1e3bb', 'request_id': 'req-d9089d70-5be3-4cba-b578-c10d0764077d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:23.404195 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab97625c003c4179941d697677a1e3bb', 'request_id': 'req-d9089d70-5be3-4cba-b578-c10d0764077d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:23.407197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:23.413073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab97625c003c4179941d697677a1e3bb', 'request_id': 'req-d9089d70-5be3-4cba-b578-c10d0764077d'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:23.492545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] The token cache is being invalidate because project ab97625c003c4179941d697677a1e3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:23.492884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:23.493510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-d9089d70-5be3-4cba-b578-c10d0764077d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:23.495080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1325/2598] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:23 2022] DELETE /identity/v3/projects/ab97625c003c4179941d697677a1e3bb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:23.501085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814534a-9586-4569-8c0a-0f1138dfd628 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:23.501563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814534a-9586-4569-8c0a-0f1138dfd628 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:23.501832 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814534a-9586-4569-8c0a-0f1138dfd628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:23.520808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e814534a-9586-4569-8c0a-0f1138dfd628 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:23.525298 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e814534a-9586-4569-8c0a-0f1138dfd628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:23.603867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1274/2599] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:23.605855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab226-2cd6-42b8-86e4-3eca2e75f918 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:23.606146 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab226-2cd6-42b8-86e4-3eca2e75f918 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:23.606425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab226-2cd6-42b8-86e4-3eca2e75f918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:23.628042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7a6ab226-2cd6-42b8-86e4-3eca2e75f918 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:23.629272 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7a6ab226-2cd6-42b8-86e4-3eca2e75f918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:23.638003 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1326/2600] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:23.642316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814534a-9586-4569-8c0a-0f1138dfd628 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:23.652653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814534a-9586-4569-8c0a-0f1138dfd628 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:23.660811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:23.660811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:23.660811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:23.660811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:23.661437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:23.661437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:23.661437 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:23.679383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ab226-2cd6-42b8-86e4-3eca2e75f918 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:23.685364 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1275/2601] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:23.692314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ab226-2cd6-42b8-86e4-3eca2e75f918 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:23.697365 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:23.698139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:23.698433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:23.698713 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:23.699439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:23.701361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:23.803092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1327/2602] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:23 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:23.804614 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:23.814647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b528563-708f-40e6-bf87-9af7c8074201 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:23.872572 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:23.873238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:23.873523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:23.873801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:23.874521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:23.876536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:23.991739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1276/2603] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:23 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:23.996013 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.006555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998b13c-098e-4d34-998e-f3474a848801 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.011434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.012128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.012418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.012736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.013467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.015141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.026139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1328/2604] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:24.030797 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.041030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e410d-3814-4106-81a4-61833faca6bc admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.046335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a91c2-5a49-409c-a7b0-c543264ab668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.047034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a91c2-5a49-409c-a7b0-c543264ab668 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.047331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a91c2-5a49-409c-a7b0-c543264ab668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.047721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a91c2-5a49-409c-a7b0-c543264ab668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.048456 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a91c2-5a49-409c-a7b0-c543264ab668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.050056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a91c2-5a49-409c-a7b0-c543264ab668 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.063475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1277/2605] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:24.067821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.078020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0bf97-de9a-4e84-b6fe-f5773aa207e7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.085372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.086285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.086576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.086883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] PATH_INFO: `/v3/projects/2e7fdb0729e24ca8bf29ed3ad58916a4/users/a341a8534ae04c76bb2a6ad3d53a2c3f/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.103883 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7fdb0729e24ca8bf29ed3ad58916a4, user_id=a341a8534ae04c76bb2a6ad3d53a2c3f, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.107153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.190472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1329/2606] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:24 2022] PUT /identity/v3/projects/2e7fdb0729e24ca8bf29ed3ad58916a4/users/a341a8534ae04c76bb2a6ad3d53a2c3f/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:24.203699 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775035-f34e-4d04-8775-8b30446409a7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.203991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775035-f34e-4d04-8775-8b30446409a7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.204278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775035-f34e-4d04-8775-8b30446409a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.236994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-57775035-f34e-4d04-8775-8b30446409a7 None None] MFA Rules not processed for user `a341a8534ae04c76bb2a6ad3d53a2c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:24.238264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-57775035-f34e-4d04-8775-8b30446409a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:24.279237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:24.305293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1278/2607] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:24.310204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.384036 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31230a39-15f3-4c78-ae00-6d0110f82701 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.388633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.389856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.390139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.390414 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.391137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.393034 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.477747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1330/2608] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:24 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:24.479056 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775035-f34e-4d04-8775-8b30446409a7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.496044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775035-f34e-4d04-8775-8b30446409a7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.558579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.559565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.560156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.560487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.561962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.564220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.669262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1279/2609] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:24 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:24.671693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.683119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dad15-d290-4271-affd-1db26bfbcc19 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.693751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.693751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.694164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.694380 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.695099 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.696712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.711712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1331/2610] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:24.721507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.733967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13e14-6bad-4db8-b9d5-20c3611a5750 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.748304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.750004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.751071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.751386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] PATH_INFO: `/v3/projects/3d1a967580e449c5b0941f4b8ad68598/users/f13d7c6b0e824131913bc2f41e2ca8f8/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.777641 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1a967580e449c5b0941f4b8ad68598, user_id=f13d7c6b0e824131913bc2f41e2ca8f8, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.780502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.861449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1280/2611] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:24 2022] PUT /identity/v3/projects/3d1a967580e449c5b0941f4b8ad68598/users/f13d7c6b0e824131913bc2f41e2ca8f8/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:24.865683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.877903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24252cad-729a-48cd-9fa1-f3c95c94764d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.933784 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:24.945526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7076aa6-34b4-49d3-9b30-42d8d5ba0631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.945526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7076aa6-34b4-49d3-9b30-42d8d5ba0631 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.945526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7076aa6-34b4-49d3-9b30-42d8d5ba0631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.945526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7076aa6-34b4-49d3-9b30-42d8d5ba0631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.945967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7076aa6-34b4-49d3-9b30-42d8d5ba0631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.945967 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7076aa6-34b4-49d3-9b30-42d8d5ba0631 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:24.955833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1332/2612] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:24.960537 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:24.987677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0355-08b0-4576-ab1b-f420c4c6779b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:24.992709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:24.993686 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:24.994042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:24.994400 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] PATH_INFO: `/v3/projects/3d1a967580e449c5b0941f4b8ad68598/users/f13d7c6b0e824131913bc2f41e2ca8f8/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:24.996560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1a967580e449c5b0941f4b8ad68598, user_id=f13d7c6b0e824131913bc2f41e2ca8f8, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:24.999996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:25.011482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1281/2613] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:24 2022] PUT /identity/v3/projects/3d1a967580e449c5b0941f4b8ad68598/users/f13d7c6b0e824131913bc2f41e2ca8f8/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:25.022876 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:25.023257 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:25.023609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:25.050916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] MFA Rules not processed for user `f13d7c6b0e824131913bc2f41e2ca8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:25.052136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:25.136030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1333/2614] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:25.143703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:25.145786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:25.205232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2c423-e644-4ff4-a021-e45323ca17b7 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:25.209726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:25.209921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:25.210208 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:25.210487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:25.219866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:25.221358 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:25.233483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1282/2615] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:25.262952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:25.267069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:25.329416 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6395a-ab28-4342-b9c8-440f4421b22a None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:25.334303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:25.335218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:25.335508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:25.335791 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] PATH_INFO: `/v3/users/a7bc17464f3346d0aba238a2dee0dc47` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:25.337105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7bc17464f3346d0aba238a2dee0dc47)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:25.339133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:25.416790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:25.426173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f909dc-086c-4fff-ac50-55be16b6d0a8 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:25.429861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:25.430521 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:25.430838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:25.431115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:25.463609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:25.488325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:25.489757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:25.499346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1283/2616] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:25.508746 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7bc17464f3346d0aba238a2dee0dc47'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:25.516675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7bc17464f3346d0aba238a2dee0dc47'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:25.517359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7bc17464f3346d0aba238a2dee0dc47'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:25.517966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7bc17464f3346d0aba238a2dee0dc47'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:25.530886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7bc17464f3346d0aba238a2dee0dc47'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:25.536170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:25.607066 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1334/2617] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:25 2022] DELETE /identity/v3/users/a7bc17464f3346d0aba238a2dee0dc47 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:25.877109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:25.888595 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b66bf-37cf-433c-89be-ef26d427d47a service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:25.951682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:25.953054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:25.953336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:25.953615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] PATH_INFO: `/v3/projects/ed7f3e35bb9a4f2ea707996c3c46acfb` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:25.954850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7f3e35bb9a4f2ea707996c3c46acfb)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:25.956805 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:26.058746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'request_id': 'req-6870139a-0def-4bb4-8d25-ae24a50946e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.065420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'request_id': 'req-6870139a-0def-4bb4-8d25-ae24a50946e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.070894 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7f3e35bb9a4f2ea707996c3c46acfb', 'request_id': 'req-6870139a-0def-4bb4-8d25-ae24a50946e1'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.145019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] The token cache is being invalidate because project ed7f3e35bb9a4f2ea707996c3c46acfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:26.145306 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.152576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.152576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1284/2618] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:25 2022] DELETE /identity/v3/projects/ed7f3e35bb9a4f2ea707996c3c46acfb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:26.155276 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:26.157119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:26.171137 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79c683-61e1-4992-abd7-2654cf7fb7a7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:26.228998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:26.231011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:26.231011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:26.231011 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] PATH_INFO: `/v3/users/a537e262dded4fdf9681f754bfdf4d16` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:26.232501 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a537e262dded4fdf9681f754bfdf4d16)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:26.234090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:26.287803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:26.289302 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:26.349174 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870139a-0def-4bb4-8d25-ae24a50946e1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:26.353178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:26.354135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:26.356444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:26.356444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:26.357646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:26.377268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:26.421585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:26.423048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:26.432692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1285/2619] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:26.440923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a537e262dded4fdf9681f754bfdf4d16'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.448611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a537e262dded4fdf9681f754bfdf4d16'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.449328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a537e262dded4fdf9681f754bfdf4d16'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.449936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a537e262dded4fdf9681f754bfdf4d16'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.466231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a537e262dded4fdf9681f754bfdf4d16'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:26.546350 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1335/2620] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:26 2022] DELETE /identity/v3/users/a537e262dded4fdf9681f754bfdf4d16 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:26.825533 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:26.827840 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:26.842184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9395a-3ecf-4fcd-8a71-2143883d7594 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:26.907213 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:26.908079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:26.908403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:26.908679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] PATH_INFO: `/v3/projects/911a19628e5b4b3480c7a5c83c4d8504` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:26.909864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=911a19628e5b4b3480c7a5c83c4d8504)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:26.911822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:27.027197 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911a19628e5b4b3480c7a5c83c4d8504', 'request_id': 'req-091cadbd-afbe-46eb-a445-65c1f985c66b'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:27.033824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911a19628e5b4b3480c7a5c83c4d8504', 'request_id': 'req-091cadbd-afbe-46eb-a445-65c1f985c66b'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:27.039655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911a19628e5b4b3480c7a5c83c4d8504', 'request_id': 'req-091cadbd-afbe-46eb-a445-65c1f985c66b'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:27.156726 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] The token cache is being invalidate because project 911a19628e5b4b3480c7a5c83c4d8504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:27.157093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:27.157791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-091cadbd-afbe-46eb-a445-65c1f985c66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:27.159407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1286/2621] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:26 2022] DELETE /identity/v3/projects/911a19628e5b4b3480c7a5c83c4d8504 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:31.873680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:31.875870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:31.903562 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e94be-483a-4d00-8ed1-bcee87898c90 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:31.943992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:31.944932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:31.945300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:31.945581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] PATH_INFO: `/v3/users/a341a8534ae04c76bb2a6ad3d53a2c3f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:31.946793 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a341a8534ae04c76bb2a6ad3d53a2c3f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:31.948787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:31.964411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:32.134504 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a341a8534ae04c76bb2a6ad3d53a2c3f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:32.141164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a341a8534ae04c76bb2a6ad3d53a2c3f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:32.141811 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a341a8534ae04c76bb2a6ad3d53a2c3f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:32.142418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a341a8534ae04c76bb2a6ad3d53a2c3f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:32.154200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a341a8534ae04c76bb2a6ad3d53a2c3f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:32.235453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1336/2622] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:31 2022] DELETE /identity/v3/users/a341a8534ae04c76bb2a6ad3d53a2c3f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:32.239866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:32.240328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:32.240450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:32.257526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:32.258708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:32.297788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:32.315764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1287/2623] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:32.325442 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:32.326924 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:32.389456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2264e-ab36-4fe8-8caf-13d409a4003a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:32.393790 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:32.394433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:32.394716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:32.395027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:32.404757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:32.406265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:32.416584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1337/2624] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:32.781864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:32.783315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:32.795474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913831-2a5e-452c-875b-8be72f24acfb None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:32.800430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:32.801313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:32.801597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:32.801877 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] PATH_INFO: `/v3/projects/2e7fdb0729e24ca8bf29ed3ad58916a4` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:32.803119 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7fdb0729e24ca8bf29ed3ad58916a4)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:32.805036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:32.917710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7fdb0729e24ca8bf29ed3ad58916a4', 'request_id': 'req-95c6599a-525c-45d1-b9cd-2c97ec7af391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:32.924252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7fdb0729e24ca8bf29ed3ad58916a4', 'request_id': 'req-95c6599a-525c-45d1-b9cd-2c97ec7af391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:32.930181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7fdb0729e24ca8bf29ed3ad58916a4', 'request_id': 'req-95c6599a-525c-45d1-b9cd-2c97ec7af391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.020648 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] The token cache is being invalidate because project 2e7fdb0729e24ca8bf29ed3ad58916a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:33.021530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.022320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.023566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1288/2625] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:32 2022] DELETE /identity/v3/projects/2e7fdb0729e24ca8bf29ed3ad58916a4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:33.027577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:33.038082 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eb5d1-e434-4b1f-a6a8-3073f6de40e5 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:33.094049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:33.094952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:33.095233 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:33.095505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] PATH_INFO: `/v3/users/f13d7c6b0e824131913bc2f41e2ca8f8` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:33.096692 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13d7c6b0e824131913bc2f41e2ca8f8)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:33.098596 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:33.249819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:33.256121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13d7c6b0e824131913bc2f41e2ca8f8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.262750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13d7c6b0e824131913bc2f41e2ca8f8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.263432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13d7c6b0e824131913bc2f41e2ca8f8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.264053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13d7c6b0e824131913bc2f41e2ca8f8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.275555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-77ae99fe-024e-428a-a677-bb63b7a5f057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13d7c6b0e824131913bc2f41e2ca8f8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.333877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1338/2626] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:33 2022] DELETE /identity/v3/users/f13d7c6b0e824131913bc2f41e2ca8f8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:33.724555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:33.726184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:33.740923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6599a-525c-45d1-b9cd-2c97ec7af391 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:33.796294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:33.797714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:33.798002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:33.798281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] PATH_INFO: `/v3/projects/3d1a967580e449c5b0941f4b8ad68598` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:33.799468 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1a967580e449c5b0941f4b8ad68598)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:33.801361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:33.887722 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1a967580e449c5b0941f4b8ad68598', 'request_id': 'req-aecdeb15-a005-43ba-a4b8-80f3ee372828'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.894259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1a967580e449c5b0941f4b8ad68598', 'request_id': 'req-aecdeb15-a005-43ba-a4b8-80f3ee372828'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.899731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1a967580e449c5b0941f4b8ad68598', 'request_id': 'req-aecdeb15-a005-43ba-a4b8-80f3ee372828'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.940434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:33.944781 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] The token cache is being invalidate because project 3d1a967580e449c5b0941f4b8ad68598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:33.945070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.945688 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aecdeb15-a005-43ba-a4b8-80f3ee372828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:33.947231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1289/2627] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:33 2022] DELETE /identity/v3/projects/3d1a967580e449c5b0941f4b8ad68598 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:33.952223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca376bf-24ee-4cd3-98d6-08f90e3890e6 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:33.952737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca376bf-24ee-4cd3-98d6-08f90e3890e6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:33.952841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca376bf-24ee-4cd3-98d6-08f90e3890e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:33.971559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4ca376bf-24ee-4cd3-98d6-08f90e3890e6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:33.972759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4ca376bf-24ee-4cd3-98d6-08f90e3890e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:34.030261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1339/2628] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:34.039099 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a863340-8a01-47f7-8fe1-d7d96027821c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.039394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a863340-8a01-47f7-8fe1-d7d96027821c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.039678 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a863340-8a01-47f7-8fe1-d7d96027821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.058803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-5a863340-8a01-47f7-8fe1-d7d96027821c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:34.060030 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5a863340-8a01-47f7-8fe1-d7d96027821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:34.068198 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1290/2629] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:34.072240 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca376bf-24ee-4cd3-98d6-08f90e3890e6 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.082273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca376bf-24ee-4cd3-98d6-08f90e3890e6 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.086946 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.087611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.087923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.088204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.088943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:34.089253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.090954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:34.103128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1340/2630] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:34.107413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a863340-8a01-47f7-8fe1-d7d96027821c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.116485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a863340-8a01-47f7-8fe1-d7d96027821c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.121066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.121708 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.121996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.122276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.123011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.124896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:34.204281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1291/2631] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:34 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:34.212174 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.222576 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f89220-1a6f-4c3d-8b10-6074eb6591ae admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.278402 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.279102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.279391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.279671 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.280391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.282348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:34.403135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1341/2632] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:34 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:34.407395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.417507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b5e8-0f3d-45d6-8215-f8267a63f3a1 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.422545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.423239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.423524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.423796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.424579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.426156 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:34.436504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1292/2633] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:34.441062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.451097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e61ed7-f4d4-4ee1-a1a5-48c23544418e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.456523 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d27a-70bb-4668-b544-1484e0a5f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.457176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d27a-70bb-4668-b544-1484e0a5f0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.457468 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d27a-70bb-4668-b544-1484e0a5f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.457747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d27a-70bb-4668-b544-1484e0a5f0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.458469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76d27a-70bb-4668-b544-1484e0a5f0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.460094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76d27a-70bb-4668-b544-1484e0a5f0c4 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:34.469881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1342/2634] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:34.473944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.483935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355c40-047b-434c-a46c-90abc0b04f12 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.488475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.489339 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.489623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.489900 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] PATH_INFO: `/v3/projects/bbf9b87c52b04bb4b40f507c796f5adb/users/67778d8654204ad887e83b5a5f67de0b/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.504481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf9b87c52b04bb4b40f507c796f5adb, user_id=67778d8654204ad887e83b5a5f67de0b, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.507137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:34.580623 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1293/2635] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:34 2022] PUT /identity/v3/projects/bbf9b87c52b04bb4b40f507c796f5adb/users/67778d8654204ad887e83b5a5f67de0b/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:34.592061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aeb31-e37e-4acc-b77c-c4b5774b5e65 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.592499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aeb31-e37e-4acc-b77c-c4b5774b5e65 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.592870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aeb31-e37e-4acc-b77c-c4b5774b5e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.619989 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-046aeb31-e37e-4acc-b77c-c4b5774b5e65 None None] MFA Rules not processed for user `67778d8654204ad887e83b5a5f67de0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:34.621206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-046aeb31-e37e-4acc-b77c-c4b5774b5e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:34.630922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:34.684933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1343/2636] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:34.696638 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.698317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:34.754974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72855ef-f587-4a2e-bb4a-9e8da92448c7 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.758591 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917d42a-0c3c-4758-9163-567c2fcd4804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.759258 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917d42a-0c3c-4758-9163-567c2fcd4804 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.759539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917d42a-0c3c-4758-9163-567c2fcd4804 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.759811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917d42a-0c3c-4758-9163-567c2fcd4804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.767990 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917d42a-0c3c-4758-9163-567c2fcd4804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.769413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917d42a-0c3c-4758-9163-567c2fcd4804 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:34.779382 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1294/2637] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:34.798705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aeb31-e37e-4acc-b77c-c4b5774b5e65 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:34.860542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aeb31-e37e-4acc-b77c-c4b5774b5e65 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:34.865338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:34.866197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:34.866477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:34.866750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] PATH_INFO: `/v3/users/67778d8654204ad887e83b5a5f67de0b` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:34.867992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67778d8654204ad887e83b5a5f67de0b)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:34.869927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:35.071511 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67778d8654204ad887e83b5a5f67de0b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.079112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67778d8654204ad887e83b5a5f67de0b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.079822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67778d8654204ad887e83b5a5f67de0b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.080487 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67778d8654204ad887e83b5a5f67de0b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.092755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67778d8654204ad887e83b5a5f67de0b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.190335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1344/2638] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:34 2022] DELETE /identity/v3/users/67778d8654204ad887e83b5a5f67de0b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:35.194946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:35.195233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:35.195508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:35.212714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:35.213917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:35.271841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1295/2639] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:35.281451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:35.282894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:35.318488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:35.341042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba877c4-5022-4934-b990-7cbf05a7864d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:35.344672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4affad3-369e-4d15-8ade-b01fd67081d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:35.345313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4affad3-369e-4d15-8ade-b01fd67081d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:35.349190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4affad3-369e-4d15-8ade-b01fd67081d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:35.349190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4affad3-369e-4d15-8ade-b01fd67081d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:35.355490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4affad3-369e-4d15-8ade-b01fd67081d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:35.356933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4affad3-369e-4d15-8ade-b01fd67081d9 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:35.377156 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1345/2640] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:35.745513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:35.747201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:35.760782 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddbbfe-14b6-49b9-95ef-0bb58ce21373 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:35.765523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:35.776033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:35.776033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:35.776033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] PATH_INFO: `/v3/projects/bbf9b87c52b04bb4b40f507c796f5adb` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:35.776033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf9b87c52b04bb4b40f507c796f5adb)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:35.776033 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:35.887004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:35.899408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf9b87c52b04bb4b40f507c796f5adb', 'request_id': 'req-79d6730b-2232-47d1-8bac-752ad802b405'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.905466 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf9b87c52b04bb4b40f507c796f5adb', 'request_id': 'req-79d6730b-2232-47d1-8bac-752ad802b405'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.910935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf9b87c52b04bb4b40f507c796f5adb', 'request_id': 'req-79d6730b-2232-47d1-8bac-752ad802b405'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.983272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] The token cache is being invalidate because project bbf9b87c52b04bb4b40f507c796f5adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:35.983564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.985392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-79d6730b-2232-47d1-8bac-752ad802b405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:35.987232 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1296/2641] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:35 2022] DELETE /identity/v3/projects/bbf9b87c52b04bb4b40f507c796f5adb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:35.993577 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a231-8c01-4eb6-a4ff-4d51fd475dcc None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:35.993981 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a231-8c01-4eb6-a4ff-4d51fd475dcc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:35.994209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a231-8c01-4eb6-a4ff-4d51fd475dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.012424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-fc57a231-8c01-4eb6-a4ff-4d51fd475dcc None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:36.013628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fc57a231-8c01-4eb6-a4ff-4d51fd475dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:36.071324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1346/2642] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:36.079823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2006e8-d2f9-4eca-be5c-25399763d071 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.080138 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2006e8-d2f9-4eca-be5c-25399763d071 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.080420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2006e8-d2f9-4eca-be5c-25399763d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.100066 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6a2006e8-d2f9-4eca-be5c-25399763d071 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:36.101299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6a2006e8-d2f9-4eca-be5c-25399763d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:36.110738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1297/2643] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:36.115165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a231-8c01-4eb6-a4ff-4d51fd475dcc None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:36.125124 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a231-8c01-4eb6-a4ff-4d51fd475dcc None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:36.130455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:36.131148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.131439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.131717 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.132449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:36.132758 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:36.134352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:36.145927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1347/2644] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:36.150161 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2006e8-d2f9-4eca-be5c-25399763d071 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:36.159637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2006e8-d2f9-4eca-be5c-25399763d071 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:36.164366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:36.165017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.165304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.165627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.166316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:36.168252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:36.282461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1298/2645] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:36 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:36.286579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:36.296845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d62e-80c6-469d-9b8b-df28c5446a2f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:36.353191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:36.354318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.354609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.354919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.355882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:36.357795 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:36.441881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1348/2646] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:36 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:36.445897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:36.456160 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef909db6-7f98-43ac-95dd-8608d6479c5c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:36.460806 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:36.461465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.461746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.462023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.462796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:36.464481 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:36.475482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1299/2647] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:36.479294 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:36.490357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586a81c-e372-4499-9870-e5120b8c4a28 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:36.494999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3da4b-2e2f-491c-af56-424a106ccfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:36.495775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3da4b-2e2f-491c-af56-424a106ccfdb admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.496061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3da4b-2e2f-491c-af56-424a106ccfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.496337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3da4b-2e2f-491c-af56-424a106ccfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.497051 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3da4b-2e2f-491c-af56-424a106ccfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:36.498626 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3da4b-2e2f-491c-af56-424a106ccfdb admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:36.508419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1349/2648] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:36.512336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:36.521904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a906-0112-48b4-9416-576d5a0e2264 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:36.526410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:36.527372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.527653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.527931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] PATH_INFO: `/v3/projects/f6349c1f0e374b0b87f64a45509f2660/users/01940c2ed024495d88541ca830b4d391/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.542646 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6349c1f0e374b0b87f64a45509f2660, user_id=01940c2ed024495d88541ca830b4d391, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:36.545439 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:36.614513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1300/2649] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:36 2022] PUT /identity/v3/projects/f6349c1f0e374b0b87f64a45509f2660/users/01940c2ed024495d88541ca830b4d391/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:36.624701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70618-c430-4fef-b834-ccc6bc6430cc None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.624998 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70618-c430-4fef-b834-ccc6bc6430cc None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.625295 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70618-c430-4fef-b834-ccc6bc6430cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.651379 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7be70618-c430-4fef-b834-ccc6bc6430cc None None] MFA Rules not processed for user `01940c2ed024495d88541ca830b4d391`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:36.652625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7be70618-c430-4fef-b834-ccc6bc6430cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:36.682149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:36.716919 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1350/2650] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:36.728153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:36.729824 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:36.786586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb894ed-ea49-4014-88c7-32d662c914c9 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:36.790207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:36.790865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:36.791151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:36.791427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:36.801098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:36.802657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:36.811742 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1301/2651] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:38.507302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:38.507846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:38.507846 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:38.525478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] MFA Rules not processed for user `01940c2ed024495d88541ca830b4d391`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:38.526712 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:38.537980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1351/2652] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:46.807777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:48.520147 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=17 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:50.745345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:50.747300 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:50.812807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92762-90d2-4e48-8c9c-f10e5070c858 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:50.816259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3b78-b57c-460a-b4e8-865b5a027a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:50.816896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3b78-b57c-460a-b4e8-865b5a027a5c service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:50.817181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3b78-b57c-460a-b4e8-865b5a027a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:50.817461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3b78-b57c-460a-b4e8-865b5a027a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:50.819295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4cef3b78-b57c-460a-b4e8-865b5a027a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:50.892650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3b78-b57c-460a-b4e8-865b5a027a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:50.892650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3b78-b57c-460a-b4e8-865b5a027a5c service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:50.901965 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1302/2653] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:53.592915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:53.595048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:53.609029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584bfbc-59fa-4ae6-a4cf-48bb49dfa8c9 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:53.613559 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:53.614456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:53.614739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:53.615055 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] PATH_INFO: `/v3/users/b9fcc06c61104ec3b82a07d3218aa499` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:53.616235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9fcc06c61104ec3b82a07d3218aa499)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:53.618153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:53.896880 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9fcc06c61104ec3b82a07d3218aa499'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:53.905470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9fcc06c61104ec3b82a07d3218aa499'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:53.906246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9fcc06c61104ec3b82a07d3218aa499'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:53.906916 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9fcc06c61104ec3b82a07d3218aa499'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:53.922298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9fcc06c61104ec3b82a07d3218aa499'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:53.996985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1352/2654] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:53 2022] DELETE /identity/v3/users/b9fcc06c61104ec3b82a07d3218aa499 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:54.005304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:54.005817 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:54.005924 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:54.023441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:54.024628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:54.086991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1303/2655] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:54.104848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:54.107186 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:54.182143 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde178e-c2e0-435c-a39a-f52c539cc71a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:54.192040 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:54.192743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:54.193014 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:54.193301 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:54.205968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:54.207658 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:54.219001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1353/2656] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:54.810652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:54.810652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:54.823714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e2fac-3e45-49cd-bbf8-581e3f03d94f None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:54.829793 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:54.830714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:54.830986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:54.831264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] PATH_INFO: `/v3/projects/e1aa6de2357f4de199c7f85cb4357fd5` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:54.832546 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1aa6de2357f4de199c7f85cb4357fd5)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:54.834500 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:54.884266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:54.885942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:54.903271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b31da-6385-4eeb-93c2-aacfaa39248a service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:54.908590 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:54.909452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:54.909737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:54.910019 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] PATH_INFO: `/v3/users/8e3e567058964720964d98e76e55e462` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:54.911219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3e567058964720964d98e76e55e462)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:54.913221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:54.964992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:54.967814 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1aa6de2357f4de199c7f85cb4357fd5', 'request_id': 'req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:54.974603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1aa6de2357f4de199c7f85cb4357fd5', 'request_id': 'req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:54.980610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1aa6de2357f4de199c7f85cb4357fd5', 'request_id': 'req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.086193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] The token cache is being invalidate because project e1aa6de2357f4de199c7f85cb4357fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:55.086881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.087187 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.088833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1304/2657] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:54 2022] DELETE /identity/v3/projects/e1aa6de2357f4de199c7f85cb4357fd5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:55.092833 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:55.095230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:55.115229 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3e567058964720964d98e76e55e462'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.128121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3e567058964720964d98e76e55e462'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.129221 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3e567058964720964d98e76e55e462'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.130007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3e567058964720964d98e76e55e462'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.146395 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:55.149355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3e567058964720964d98e76e55e462'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.173202 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd455f-adaa-4df1-8314-cdf5ca5351bc admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:55.179150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:55.179150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:55.179150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:55.179444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] PATH_INFO: `/v3/users/6ce3618b442e4d71a23ae5846287d848` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:55.180519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce3618b442e4d71a23ae5846287d848)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:55.182455 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:55.258324 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1354/2658] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:54 2022] DELETE /identity/v3/users/8e3e567058964720964d98e76e55e462 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:55.419998 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce3618b442e4d71a23ae5846287d848'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.477135 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce3618b442e4d71a23ae5846287d848'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.485094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce3618b442e4d71a23ae5846287d848'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.485761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce3618b442e4d71a23ae5846287d848'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.486394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce3618b442e4d71a23ae5846287d848'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.505828 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1305/2659] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:55 2022] DELETE /identity/v3/users/6ce3618b442e4d71a23ae5846287d848 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:55.508004 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:55.510716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:55.603840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca0c3b-d5f7-41d0-a51d-a36bd7794e6f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:55.674490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:55.675403 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:55.675802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:55.676080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] PATH_INFO: `/v3/projects/27cd77392b924e64ba52350c775cf638` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:55.677400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cd77392b924e64ba52350c775cf638)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:55.679392 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:55.810550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cd77392b924e64ba52350c775cf638', 'request_id': 'req-ea102144-11b4-4e30-9f09-5523e0307748'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.819778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cd77392b924e64ba52350c775cf638', 'request_id': 'req-ea102144-11b4-4e30-9f09-5523e0307748'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.826494 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cd77392b924e64ba52350c775cf638', 'request_id': 'req-ea102144-11b4-4e30-9f09-5523e0307748'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.902964 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] The token cache is being invalidate because project 27cd77392b924e64ba52350c775cf638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:55.903616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.903925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-ea102144-11b4-4e30-9f09-5523e0307748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:55.905061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:55.905587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1355/2660] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:55 2022] DELETE /identity/v3/projects/27cd77392b924e64ba52350c775cf638 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:55.909972 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:55.910473 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e558-7425-413d-b2aa-d51ad370ccf9 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:55.910767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e558-7425-413d-b2aa-d51ad370ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:55.911094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e558-7425-413d-b2aa-d51ad370ccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:55.926069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8682e-a86c-416a-b505-0356b403aecc admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:55.944678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-20c6e558-7425-413d-b2aa-d51ad370ccf9 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:55.944678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-20c6e558-7425-413d-b2aa-d51ad370ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:55.952426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:55.978170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:55.988063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:55.988925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:55.989289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:55.989508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] PATH_INFO: `/v3/projects/7d8456b992804c78a7861c9e6fa9b350` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:55.990695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8456b992804c78a7861c9e6fa9b350)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:55.992660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:55.994994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1356/2661] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:56.002237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce649878-6b85-4648-8304-1ba2c4c33667 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.002530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce649878-6b85-4648-8304-1ba2c4c33667 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.005247 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce649878-6b85-4648-8304-1ba2c4c33667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.020538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ce649878-6b85-4648-8304-1ba2c4c33667 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:56.021780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ce649878-6b85-4648-8304-1ba2c4c33667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:56.029724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1357/2662] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:56.034607 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce649878-6b85-4648-8304-1ba2c4c33667 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.043838 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce649878-6b85-4648-8304-1ba2c4c33667 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.050017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.050670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.051059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.051343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.056877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:56.056877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.056877 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.065352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1358/2663] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:15:56.069648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.078971 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab423be3-e852-4fcb-a17d-0a24526b676d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.094305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8456b992804c78a7861c9e6fa9b350', 'request_id': 'req-8ff5bc49-c440-46da-a9da-a0e2f019bf47'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:56.100999 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8456b992804c78a7861c9e6fa9b350', 'request_id': 'req-8ff5bc49-c440-46da-a9da-a0e2f019bf47'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:56.106901 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8456b992804c78a7861c9e6fa9b350', 'request_id': 'req-8ff5bc49-c440-46da-a9da-a0e2f019bf47'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:56.135052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.135711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.135993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.136308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.136976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.138898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.189620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] The token cache is being invalidate because project 7d8456b992804c78a7861c9e6fa9b350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:56.189919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:56.190571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-8ff5bc49-c440-46da-a9da-a0e2f019bf47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:56.192396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1306/2664] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:55 2022] DELETE /identity/v3/projects/7d8456b992804c78a7861c9e6fa9b350 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:56.196880 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7be394-98bc-4267-9e7a-37fd0311550c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.197294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7be394-98bc-4267-9e7a-37fd0311550c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.197674 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7be394-98bc-4267-9e7a-37fd0311550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.216764 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-2f7be394-98bc-4267-9e7a-37fd0311550c None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:56.218082 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-2f7be394-98bc-4267-9e7a-37fd0311550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:56.226703 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1307/2665] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:56.238062 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a035-c7fe-4f6e-a0a0-a81fd1cb9ea2 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.238507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a035-c7fe-4f6e-a0a0-a81fd1cb9ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.238777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a035-c7fe-4f6e-a0a0-a81fd1cb9ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.244335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1359/2666] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:56.248908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.250538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:56.258780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-7ab1a035-c7fe-4f6e-a0a0-a81fd1cb9ea2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:56.260164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7ab1a035-c7fe-4f6e-a0a0-a81fd1cb9ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:56.324921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1308/2667] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:56.328232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b6ceb-3fd0-4170-8902-efc5048a4161 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.329204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1a035-c7fe-4f6e-a0a0-a81fd1cb9ea2 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.333815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.334856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.334992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.335266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.336077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.338211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.338651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1a035-c7fe-4f6e-a0a0-a81fd1cb9ea2 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.343883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.344816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.345262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.345538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.346279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:56.346582 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.348403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.361524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1309/2668] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:15:56.365919 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.375449 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8f0bd-a732-46f1-a3be-1046663a80a0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.379964 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.380589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.399011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.399011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.399011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.399011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.453157 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1360/2669] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/users => generated 282 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:56.457129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.466637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3839d99-b6e3-4658-b5a1-f64916cf0454 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.471882 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.472521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.472809 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.473089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.473957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.475776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.483907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1310/2670] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:56.486938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1361/2671] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:56.490184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.490338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.500308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefefc6-50ad-4fcc-84bc-25d2288f7c70 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.551544 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd3571-5d4e-42e3-b190-2be14bec5c62 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.556053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.556217 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.556814 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.556946 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.557098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.557227 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.557382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.557485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.558079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.558212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.559734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.560136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.570281 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1362/2672] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:56.574383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.584293 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274272a3-e927-4716-8a2c-ddc63a64e0ab admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.588865 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34781fab-1de7-402c-9314-b4c96be90324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.589716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34781fab-1de7-402c-9314-b4c96be90324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.593958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34781fab-1de7-402c-9314-b4c96be90324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.593958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34781fab-1de7-402c-9314-b4c96be90324 admin admin] PATH_INFO: `/v3/projects/b206e0c73c894a179f73d408cf87992a/users/74231218386a48908b73c74474fc9212/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.605054 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34781fab-1de7-402c-9314-b4c96be90324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b206e0c73c894a179f73d408cf87992a, user_id=74231218386a48908b73c74474fc9212, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.607960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34781fab-1de7-402c-9314-b4c96be90324 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.641558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1311/2673] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/users => generated 305 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:56.645512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.655171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1117fd8-cd73-4fba-8a54-2bf7dcece1d5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.660613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.661258 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.661548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.668410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.668410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.668410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.673888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1312/2674] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:56.677653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.686759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497de67-df3c-451e-9b7b-316c48b014ff admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.691451 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.692064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.692354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.692634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.693338 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.694916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.705651 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1313/2675] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:56.709475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.719426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642f7f-7252-4e0e-ad3f-9bfa35c9b740 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.723941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29594eec-92b1-40cc-a94d-0e82e76bf439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.724762 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594eec-92b1-40cc-a94d-0e82e76bf439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.725046 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594eec-92b1-40cc-a94d-0e82e76bf439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.725321 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594eec-92b1-40cc-a94d-0e82e76bf439 admin admin] PATH_INFO: `/v3/projects/eae05a9beace4655afc10584f6cd080a/users/9f41d8d31997460fa3d717705f9e6460/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.739621 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29594eec-92b1-40cc-a94d-0e82e76bf439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae05a9beace4655afc10584f6cd080a, user_id=9f41d8d31997460fa3d717705f9e6460, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.749280 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1363/2676] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:56 2022] PUT /identity/v3/projects/b206e0c73c894a179f73d408cf87992a/users/74231218386a48908b73c74474fc9212/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:56.749992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29594eec-92b1-40cc-a94d-0e82e76bf439 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.751064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f0ed-ed1c-4b20-888d-5e8cebbd7de3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.751361 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f0ed-ed1c-4b20-888d-5e8cebbd7de3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.751641 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f0ed-ed1c-4b20-888d-5e8cebbd7de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.768556 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:56.778275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-b097f0ed-ed1c-4b20-888d-5e8cebbd7de3 None None] MFA Rules not processed for user `74231218386a48908b73c74474fc9212`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:56.779701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b097f0ed-ed1c-4b20-888d-5e8cebbd7de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:56.842106 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1364/2677] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:56.846409 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f0ed-ed1c-4b20-888d-5e8cebbd7de3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.871531 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1314/2678] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:56 2022] PUT /identity/v3/projects/eae05a9beace4655afc10584f6cd080a/users/9f41d8d31997460fa3d717705f9e6460/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:56.882255 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323f49-223b-46f0-83c8-bda69d66885c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.882557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323f49-223b-46f0-83c8-bda69d66885c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.882862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323f49-223b-46f0-83c8-bda69d66885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.891802 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:56.907565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f0ed-ed1c-4b20-888d-5e8cebbd7de3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.911002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-73323f49-223b-46f0-83c8-bda69d66885c None None] MFA Rules not processed for user `9f41d8d31997460fa3d717705f9e6460`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:56.912273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-73323f49-223b-46f0-83c8-bda69d66885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:56.964898 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.965510 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.965801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.966085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.966778 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:56.968749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:56.976095 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1315/2679] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:56.980776 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73323f49-223b-46f0-83c8-bda69d66885c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:56.991262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73323f49-223b-46f0-83c8-bda69d66885c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:56.991452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:56.995844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:56.996536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:56.996885 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:56.997177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:56.997921 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.000431 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.055571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1365/2680] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:57.059446 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.108114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1316/2681] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:56 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:57.112399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.121530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d532dd-4df6-4edd-99b3-7d2086004f05 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.178666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b2b21-a5f3-40c7-b78e-966897765844 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.183603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.184322 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.184971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.185450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.187357 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:57.189813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.190112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.190219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.190219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.190219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.190219 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.190589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.191726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.293925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1317/2682] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:57 2022] POST /identity/v3/users => generated 310 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:57.297285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1366/2683] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:57 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:57.298415 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.298574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.308221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4e947-d595-452c-b82d-32961bd25d04 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.309993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209936cc-bfd9-42f2-a8db-fd7761a1cb32 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.312899 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.313564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.313849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.314128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.314910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.315432 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.316194 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.316579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.316679 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.317103 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.317962 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.319675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.329045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1318/2684] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:57.333084 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1367/2685] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:57.333367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.337108 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.345178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f66a7-d8ac-4df4-af27-ed2987e74ae4 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.349426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed777215-df1d-4859-874d-9ea935eae390 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.359111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.359111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.359111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.359111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] PATH_INFO: `/v3/projects/8ca49356486a4f8cbbe46ea6fa4745bc/users/b001ec23faed4916878bda3c48cd4bcd/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.363249 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.364190 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.364480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.364753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] PATH_INFO: `/v3/projects/cf0420a969dc434bb1e0e942ce485613/users/a6f5b76fae494246a76899da1c16273c/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.379849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca49356486a4f8cbbe46ea6fa4745bc, user_id=b001ec23faed4916878bda3c48cd4bcd, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.384109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.385540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0420a969dc434bb1e0e942ce485613, user_id=a6f5b76fae494246a76899da1c16273c, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.389090 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.478209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1319/2686] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:57 2022] PUT /identity/v3/projects/8ca49356486a4f8cbbe46ea6fa4745bc/users/b001ec23faed4916878bda3c48cd4bcd/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:57.482633 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.509561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1368/2687] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:57 2022] PUT /identity/v3/projects/cf0420a969dc434bb1e0e942ce485613/users/a6f5b76fae494246a76899da1c16273c/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:57.510691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.517571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:57.573271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ec37c-f5a6-4d21-b3b3-90381ce12f1b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.581045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.581865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.582216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.582605 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.582980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3153daf-30be-459b-846a-18683a4db5e7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.583511 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.585231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.589650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.590467 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.590944 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.591490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.592298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.594363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.600589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1320/2688] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:57.604931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.610318 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1369/2689] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:57.614274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.619478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252708-4c12-4c61-952d-b991ce89ebbf admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.624952 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70d66-59da-408a-a707-495687367eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.628253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439af68-4107-40c6-8ddf-29559256430e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.628373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70d66-59da-408a-a707-495687367eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.628373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70d66-59da-408a-a707-495687367eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.628373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70d66-59da-408a-a707-495687367eb2 admin admin] PATH_INFO: `/v3/projects/8ca49356486a4f8cbbe46ea6fa4745bc/users/b001ec23faed4916878bda3c48cd4bcd/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.628650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70d66-59da-408a-a707-495687367eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca49356486a4f8cbbe46ea6fa4745bc, user_id=b001ec23faed4916878bda3c48cd4bcd, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.630168 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a29042-b288-4a26-a557-e8844bc1b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.631149 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29042-b288-4a26-a557-e8844bc1b033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.631274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70d66-59da-408a-a707-495687367eb2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.631557 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29042-b288-4a26-a557-e8844bc1b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.631926 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29042-b288-4a26-a557-e8844bc1b033 admin admin] PATH_INFO: `/v3/projects/cf0420a969dc434bb1e0e942ce485613/users/a6f5b76fae494246a76899da1c16273c/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.634043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a29042-b288-4a26-a557-e8844bc1b033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0420a969dc434bb1e0e942ce485613, user_id=a6f5b76fae494246a76899da1c16273c, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.636807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a29042-b288-4a26-a557-e8844bc1b033 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.642465 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1321/2690] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:57 2022] PUT /identity/v3/projects/8ca49356486a4f8cbbe46ea6fa4745bc/users/b001ec23faed4916878bda3c48cd4bcd/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:57.648921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1370/2691] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:57 2022] PUT /identity/v3/projects/cf0420a969dc434bb1e0e942ce485613/users/a6f5b76fae494246a76899da1c16273c/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:57.660536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.660536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.660536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.662110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.662405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.662690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.683613 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] MFA Rules not processed for user `b001ec23faed4916878bda3c48cd4bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:57.684891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:57.689797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] MFA Rules not processed for user `a6f5b76fae494246a76899da1c16273c`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:57.691026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:57.760950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1322/2692] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:57 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:57.772221 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.774129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:57.779701 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1371/2693] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:15:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:15:57.791363 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:57.792829 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:57.794917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:57.837191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00d19-4df2-4705-b401-d80bb76539c2 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.841626 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.842311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.842602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.842912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.852516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.853982 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.856571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfbf2-2677-4260-a8fe-b0597b29920b None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:57.860777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:57.861423 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:57.861703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:57.861974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:57.864748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1323/2694] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:57 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:57.871856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:57.873299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:57.883704 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1372/2695] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:58.088735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:58.097236 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33802bce-b673-421c-8d92-c39f83ed280e service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:58.100841 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:58.101472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:58.101757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:58.102040 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:58.159283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:58.160734 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:58.170071 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1324/2696] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:58.248537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:58.257088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d3ab-02f5-4a99-8e7d-b0a961d8b8be service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:58.260640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20013c34-138b-4f15-a4ff-9c4fa5a2d35f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:58.261266 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013c34-138b-4f15-a4ff-9c4fa5a2d35f service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:58.261547 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013c34-138b-4f15-a4ff-9c4fa5a2d35f service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:58.261821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20013c34-138b-4f15-a4ff-9c4fa5a2d35f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:58.273855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:58.319220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20013c34-138b-4f15-a4ff-9c4fa5a2d35f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:58.320602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20013c34-138b-4f15-a4ff-9c4fa5a2d35f service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:58.330002 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1373/2697] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:01.777584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:01.838560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59198-6280-478d-907c-c4b8f9c58c8e service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:01.843311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:01.844183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:01.844467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:01.844807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] PATH_INFO: `/v3/users/74231218386a48908b73c74474fc9212` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:01.845992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74231218386a48908b73c74474fc9212)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:01.847937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:01.987842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74231218386a48908b73c74474fc9212'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.048113 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74231218386a48908b73c74474fc9212'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.053245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:02.056176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74231218386a48908b73c74474fc9212'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.056801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74231218386a48908b73c74474fc9212'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.057402 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74231218386a48908b73c74474fc9212'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.073891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1325/2698] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:01 2022] DELETE /identity/v3/users/74231218386a48908b73c74474fc9212 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:02.078522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:02.079015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:02.079135 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:02.097033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:02.098236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:02.156804 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1374/2699] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:02.166794 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:02.168215 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:02.225010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22e4e0-4ac6-44c4-9e15-93cc6fe75ab5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:02.228681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:02.229326 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:02.229615 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:02.229898 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:02.239765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:02.241120 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:02.250747 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1326/2700] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:02.688512 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:02.690739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:02.704592 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604128-444c-4e62-a0a8-39daad7a2da2 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:02.710331 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:02.711455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:02.711587 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:02.711828 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] PATH_INFO: `/v3/projects/b206e0c73c894a179f73d408cf87992a` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:02.713243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b206e0c73c894a179f73d408cf87992a)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:02.715639 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:02.819145 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b206e0c73c894a179f73d408cf87992a', 'request_id': 'req-f8e3a0e5-7654-4ce2-9da8-476432bbec64'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.825138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b206e0c73c894a179f73d408cf87992a', 'request_id': 'req-f8e3a0e5-7654-4ce2-9da8-476432bbec64'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.831387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b206e0c73c894a179f73d408cf87992a', 'request_id': 'req-f8e3a0e5-7654-4ce2-9da8-476432bbec64'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.881480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] The token cache is being invalidate because project b206e0c73c894a179f73d408cf87992a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:02.881770 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.882426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:02.884128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1375/2701] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:02 2022] DELETE /identity/v3/projects/b206e0c73c894a179f73d408cf87992a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:02.888191 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:02.898526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e56e5-27a6-4eb2-82e7-67ca1415f449 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:02.952327 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:02.953185 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:02.953475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:02.953752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] PATH_INFO: `/v3/users/a6f5b76fae494246a76899da1c16273c` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:02.955585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f5b76fae494246a76899da1c16273c)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:02.957499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:03.116523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f5b76fae494246a76899da1c16273c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.177410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f5b76fae494246a76899da1c16273c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.186644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f5b76fae494246a76899da1c16273c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.187423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f5b76fae494246a76899da1c16273c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.188094 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-752a5467-8dae-4289-82b4-d218baa2fcba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f5b76fae494246a76899da1c16273c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.200701 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:03.206285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1327/2702] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:02 2022] DELETE /identity/v3/users/a6f5b76fae494246a76899da1c16273c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:03.607092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:03.608739 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:03.624376 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a0e5-7654-4ce2-9da8-476432bbec64 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:03.663485 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:03.686255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:03.687176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:03.687459 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:03.687734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] PATH_INFO: `/v3/projects/cf0420a969dc434bb1e0e942ce485613` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:03.688922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0420a969dc434bb1e0e942ce485613)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:03.691401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:03.823715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0420a969dc434bb1e0e942ce485613', 'request_id': 'req-7c64d404-640a-420b-959e-985c378ab65f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.829936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0420a969dc434bb1e0e942ce485613', 'request_id': 'req-7c64d404-640a-420b-959e-985c378ab65f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.835999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0420a969dc434bb1e0e942ce485613', 'request_id': 'req-7c64d404-640a-420b-959e-985c378ab65f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.929966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] The token cache is being invalidate because project cf0420a969dc434bb1e0e942ce485613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:03.930291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.932023 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-7c64d404-640a-420b-959e-985c378ab65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:03.937521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1376/2703] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:03 2022] DELETE /identity/v3/projects/cf0420a969dc434bb1e0e942ce485613 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:03.940017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a49b46-8680-4c98-8975-127b1fbb8650 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:03.940547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a49b46-8680-4c98-8975-127b1fbb8650 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:03.940687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a49b46-8680-4c98-8975-127b1fbb8650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:03.964693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-27a49b46-8680-4c98-8975-127b1fbb8650 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:03.966668 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-27a49b46-8680-4c98-8975-127b1fbb8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:04.045299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1328/2704] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:04.053871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c1ba-ff9c-4161-a4b2-e4552b4a4f78 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.054225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c1ba-ff9c-4161-a4b2-e4552b4a4f78 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.054428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c1ba-ff9c-4161-a4b2-e4552b4a4f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.076384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-fc91c1ba-ff9c-4161-a4b2-e4552b4a4f78 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:04.077636 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-fc91c1ba-ff9c-4161-a4b2-e4552b4a4f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:04.094319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1377/2705] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:04.101971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a49b46-8680-4c98-8975-127b1fbb8650 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.107522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a49b46-8680-4c98-8975-127b1fbb8650 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:04.113336 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:04.114005 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.114289 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.114571 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.115354 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:16:04.115666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:04.117271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:04.130789 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1329/2706] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:16:04.135063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c1ba-ff9c-4161-a4b2-e4552b4a4f78 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.144722 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c1ba-ff9c-4161-a4b2-e4552b4a4f78 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:04.152130 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:04.152802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.153089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.153369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.154073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:04.156001 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:04.240843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1378/2707] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:04 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:04.241941 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.251611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003f474-63a8-42f8-a047-c68058e03b82 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:04.308486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:04.309165 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.309499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.309779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.310489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:04.312475 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:04.431340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1330/2708] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:04 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:04.435254 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.448928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9046b-4d93-4e75-abfc-e91a0e5c3216 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:04.453763 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:04.454447 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.454727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.455048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.455801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:04.460256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:04.471965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1379/2709] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:04.475959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.489755 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418d2b-40af-4cbd-8eca-acb13432159e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:04.500011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b12ac-1dca-4b95-a504-663e02881241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:04.500011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b12ac-1dca-4b95-a504-663e02881241 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.500011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b12ac-1dca-4b95-a504-663e02881241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.500011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b12ac-1dca-4b95-a504-663e02881241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.500453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b12ac-1dca-4b95-a504-663e02881241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:04.500453 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b12ac-1dca-4b95-a504-663e02881241 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:04.511960 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1331/2710] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:04.516231 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.528616 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b9db1-1140-4294-af94-cc7830783a70 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:04.535093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:04.536144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.536506 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.536859 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] PATH_INFO: `/v3/projects/0558825d66c6480aa48f293d4b097916/users/76e8de5d541743f89e5b61e26ab86e38/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.555595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0558825d66c6480aa48f293d4b097916, user_id=76e8de5d541743f89e5b61e26ab86e38, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:04.558441 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:04.670690 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1380/2711] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:04 2022] PUT /identity/v3/projects/0558825d66c6480aa48f293d4b097916/users/76e8de5d541743f89e5b61e26ab86e38/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:04.682624 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631066-07cf-483f-a691-e493c01d25a7 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.682963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631066-07cf-483f-a691-e493c01d25a7 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.683280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631066-07cf-483f-a691-e493c01d25a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.712009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-6c631066-07cf-483f-a691-e493c01d25a7 None None] MFA Rules not processed for user `76e8de5d541743f89e5b61e26ab86e38`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:04.713313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6c631066-07cf-483f-a691-e493c01d25a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:04.767697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:04.777735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1332/2712] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:04.782302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.848158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df4681-c8a1-4612-9c00-3dcf76bffd5c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:04.852808 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:04.853479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:04.853767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:04.854048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:04.854749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:04.856933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:04.865173 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:04.951079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1381/2713] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:04 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:04.955743 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c631066-07cf-483f-a691-e493c01d25a7 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:04.966325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c631066-07cf-483f-a691-e493c01d25a7 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:05.024335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:05.025014 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:05.027707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:05.027707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:05.027707 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:05.028121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:05.104227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1333/2714] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:04 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:05.108492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:05.118939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae967-7db0-422c-8f21-35365f190caf admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:05.123640 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:05.124300 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:05.124583 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:05.124881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:05.125611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:05.127819 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:05.138603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1382/2715] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:05.147935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:05.158012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cafd8d-32ac-4950-84a5-67e95bea1185 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:05.162697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:05.163607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:05.163893 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:05.164173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] PATH_INFO: `/v3/projects/bea56945f214462b88e9166387937688/users/ab016e0a220246058b39175fce6d27a3/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:05.179111 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea56945f214462b88e9166387937688, user_id=ab016e0a220246058b39175fce6d27a3, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:05.181761 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:05.272000 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1334/2716] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:05 2022] PUT /identity/v3/projects/bea56945f214462b88e9166387937688/users/ab016e0a220246058b39175fce6d27a3/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:05.276042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:05.286138 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c152c5e-0e1d-4133-9681-da06908e864b admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:05.352844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1e48-0ca9-4d60-be21-0bf33ab0422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:05.353554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1e48-0ca9-4d60-be21-0bf33ab0422a admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:05.353843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1e48-0ca9-4d60-be21-0bf33ab0422a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:05.354122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1e48-0ca9-4d60-be21-0bf33ab0422a admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:05.354872 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1e48-0ca9-4d60-be21-0bf33ab0422a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:05.356906 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1e48-0ca9-4d60-be21-0bf33ab0422a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:05.371725 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1383/2717] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:05.372970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:05.384239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2142b5-8d95-4a8a-a856-f2a6d2ea2500 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:05.388823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:05.389768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:05.390049 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:05.390325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] PATH_INFO: `/v3/projects/bea56945f214462b88e9166387937688/users/ab016e0a220246058b39175fce6d27a3/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:05.392395 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea56945f214462b88e9166387937688, user_id=ab016e0a220246058b39175fce6d27a3, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:05.395055 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:05.405935 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1335/2718] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:05 2022] PUT /identity/v3/projects/bea56945f214462b88e9166387937688/users/ab016e0a220246058b39175fce6d27a3/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:05.417183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eba172-0b42-4ada-8950-d91ad7372dae None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:05.417474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eba172-0b42-4ada-8950-d91ad7372dae None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:05.417757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eba172-0b42-4ada-8950-d91ad7372dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:05.444374 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-99eba172-0b42-4ada-8950-d91ad7372dae None None] MFA Rules not processed for user `ab016e0a220246058b39175fce6d27a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:05.445579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-99eba172-0b42-4ada-8950-d91ad7372dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:05.514848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1384/2719] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:05.525519 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:05.527233 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:05.586150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319a3c-4884-4af4-95bb-d110749c460c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:05.589860 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:05.590506 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:05.590792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:05.591129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:05.600061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:05.601560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:05.612335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1336/2720] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:06.431542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:06.432030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:06.432139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:06.458378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:06.458378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:06.518727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1385/2721] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:16:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:06.681738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:06.683206 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:06.734536 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:06.752687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7c7ae-4c49-4437-ada7-1cb98fdb0574 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:06.757987 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb438bf-f991-40aa-9433-1bd58a9a9fd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:06.758427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb438bf-f991-40aa-9433-1bd58a9a9fd0 service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:06.758714 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb438bf-f991-40aa-9433-1bd58a9a9fd0 service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:06.759021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb438bf-f991-40aa-9433-1bd58a9a9fd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:06.767428 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb438bf-f991-40aa-9433-1bd58a9a9fd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:06.769102 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb438bf-f991-40aa-9433-1bd58a9a9fd0 service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:06.777335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1337/2722] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:16:07.537961 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:07.539428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:07.545826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:07.610850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4685c55-a676-47e9-895b-df63783b86a4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:07.616378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:07.617251 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:07.617550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:07.618060 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] PATH_INFO: `/v3/users/9f41d8d31997460fa3d717705f9e6460` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:07.619309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f41d8d31997460fa3d717705f9e6460)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:07.622624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:07.645916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e5ad-4904-41e7-86ad-21186cb4e4b3 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:07.646242 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e5ad-4904-41e7-86ad-21186cb4e4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:07.646690 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e5ad-4904-41e7-86ad-21186cb4e4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:07.666285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c805e5ad-4904-41e7-86ad-21186cb4e4b3 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:07.668303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c805e5ad-4904-41e7-86ad-21186cb4e4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:07.676779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1338/2723] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 22 09:16:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:07.690036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e5ad-4904-41e7-86ad-21186cb4e4b3 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:07.702464 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e5ad-4904-41e7-86ad-21186cb4e4b3 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:07.707504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ffb19-e73b-469a-8ee8-dc1f49f6b56b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:07.708136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ffb19-e73b-469a-8ee8-dc1f49f6b56b service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:07.708444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ffb19-e73b-469a-8ee8-dc1f49f6b56b service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:07.708715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ffb19-e73b-469a-8ee8-dc1f49f6b56b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:07.716771 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ffb19-e73b-469a-8ee8-dc1f49f6b56b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:07.720367 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ffb19-e73b-469a-8ee8-dc1f49f6b56b service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:07.726253 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1339/2724] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:16:07.816032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f41d8d31997460fa3d717705f9e6460'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:07.822982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f41d8d31997460fa3d717705f9e6460'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:07.823650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f41d8d31997460fa3d717705f9e6460'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:07.824255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f41d8d31997460fa3d717705f9e6460'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:07.836133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f41d8d31997460fa3d717705f9e6460'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:07.927759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1386/2725] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:07 2022] DELETE /identity/v3/users/9f41d8d31997460fa3d717705f9e6460 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:07.929292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422ad1-5576-465b-9fe1-520bf2dd0eaf None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:07.929575 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422ad1-5576-465b-9fe1-520bf2dd0eaf None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:07.929854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422ad1-5576-465b-9fe1-520bf2dd0eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:07.949199 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-be422ad1-5576-465b-9fe1-520bf2dd0eaf None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:07.950412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-be422ad1-5576-465b-9fe1-520bf2dd0eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.018134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1340/2726] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:08.027736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:08.029291 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.096466 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3340f-1c2c-497a-bd1e-1f39958d3fcb admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:08.100337 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:08.101095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:08.101456 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:08.101743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:08.112383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:08.113953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:08.132866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1387/2727] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:08.262580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:08.262902 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:08.263209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:08.281914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:08.283666 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.352250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1341/2728] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:16:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:08.368602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:08.370973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.407097 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:08.451384 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1caa75-9a40-460b-abb7-26ea827cd0f6 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:08.457780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:08.458672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:08.458672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:08.458991 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:08.469965 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:08.472488 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:08.482031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1388/2729] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:16:08.564539 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:08.566489 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.580725 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c42927-8903-4ff2-ba18-3dd8b6200349 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:08.585507 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:08.586372 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:08.586652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:08.586958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] PATH_INFO: `/v3/projects/eae05a9beace4655afc10584f6cd080a` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:08.597380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae05a9beace4655afc10584f6cd080a)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:08.597380 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:08.637204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:08.638621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.653046 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72408c16-3192-44ad-a807-b0057e779c32 service swift] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:08.657565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:08.659057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:08.659345 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:08.659624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] PATH_INFO: `/v3/users/76e8de5d541743f89e5b61e26ab86e38` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:08.660826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e8de5d541743f89e5b61e26ab86e38)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:08.662734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:08.722307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae05a9beace4655afc10584f6cd080a', 'request_id': 'req-f1893318-7048-4703-8164-a9165ca9567d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.729534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae05a9beace4655afc10584f6cd080a', 'request_id': 'req-f1893318-7048-4703-8164-a9165ca9567d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.734426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:08.737012 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae05a9beace4655afc10584f6cd080a', 'request_id': 'req-f1893318-7048-4703-8164-a9165ca9567d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.825669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] The token cache is being invalidate because project eae05a9beace4655afc10584f6cd080a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:08.825669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.825669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.826291 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1342/2730] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:08 2022] DELETE /identity/v3/projects/eae05a9beace4655afc10584f6cd080a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:08.831172 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:08.832655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.834769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e8de5d541743f89e5b61e26ab86e38'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.842492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e8de5d541743f89e5b61e26ab86e38'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.844993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e8de5d541743f89e5b61e26ab86e38'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.844993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e8de5d541743f89e5b61e26ab86e38'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.858133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-5d8ec276-58c1-4069-8d82-98887225a7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e8de5d541743f89e5b61e26ab86e38'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:08.902473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1893318-7048-4703-8164-a9165ca9567d admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:08.907835 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:08.908629 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1389/2731] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:08 2022] DELETE /identity/v3/users/76e8de5d541743f89e5b61e26ab86e38 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:08.910933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:08.911441 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:08.911745 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] PATH_INFO: `/v3/users/b001ec23faed4916878bda3c48cd4bcd` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:08.913331 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b001ec23faed4916878bda3c48cd4bcd)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:08.915063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:08.915359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:08.915499 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:08.915721 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:08.933105 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:08.937588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:08.999755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1390/2732] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:09.010292 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:09.016410 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:09.049216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:09.075049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d85fc-8baa-46f3-b4e8-f0c494d70e40 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:09.078627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9c76a-4da8-41fb-bbff-e3ecbba254b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:09.079338 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c76a-4da8-41fb-bbff-e3ecbba254b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:09.079644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c76a-4da8-41fb-bbff-e3ecbba254b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:09.079925 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c76a-4da8-41fb-bbff-e3ecbba254b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:09.088801 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9c76a-4da8-41fb-bbff-e3ecbba254b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:09.090223 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9c76a-4da8-41fb-bbff-e3ecbba254b6 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:09.100061 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b001ec23faed4916878bda3c48cd4bcd'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.100225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1391/2733] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:16:09.101405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:09.101699 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:09.101996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:09.124299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:09.125522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:09.174278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b001ec23faed4916878bda3c48cd4bcd'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.181729 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1392/2734] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 22 09:16:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:09.183021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b001ec23faed4916878bda3c48cd4bcd'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.184045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b001ec23faed4916878bda3c48cd4bcd'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.184643 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b001ec23faed4916878bda3c48cd4bcd'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.198026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:09.199767 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:09.205252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1343/2735] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:08 2022] DELETE /identity/v3/users/b001ec23faed4916878bda3c48cd4bcd => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:09.272595 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e9715-de3d-48e6-995b-5005471e80d0 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:09.332684 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:09.334006 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:09.334303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:09.334593 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:09.337071 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:09.401575 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:09.403246 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:09.409622 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:09.413970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1393/2736] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:16:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:16:09.581560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:09.583170 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:09.649875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:09.651581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:09.667027 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de58c6-bfd0-4933-87b3-10029e5b60ee service swift] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:09.669121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65d5e-79cc-4f95-95b5-d07e69766091 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:09.674255 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:09.675264 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:09.675460 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:09.675678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:09.676180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:09.676472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:09.676669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] PATH_INFO: `/v3/projects/8ca49356486a4f8cbbe46ea6fa4745bc` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:09.676869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] PATH_INFO: `/v3/projects/0558825d66c6480aa48f293d4b097916` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:09.679080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0558825d66c6480aa48f293d4b097916)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:09.681486 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:09.687845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca49356486a4f8cbbe46ea6fa4745bc)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:09.689842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:09.690145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:09.829357 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca49356486a4f8cbbe46ea6fa4745bc', 'request_id': 'req-b705ed60-51f0-47a5-8434-adcdf39b853b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.838026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca49356486a4f8cbbe46ea6fa4745bc', 'request_id': 'req-b705ed60-51f0-47a5-8434-adcdf39b853b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.841158 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0558825d66c6480aa48f293d4b097916', 'request_id': 'req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.846150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca49356486a4f8cbbe46ea6fa4745bc', 'request_id': 'req-b705ed60-51f0-47a5-8434-adcdf39b853b'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.851195 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0558825d66c6480aa48f293d4b097916', 'request_id': 'req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.858412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0558825d66c6480aa48f293d4b097916', 'request_id': 'req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.939787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] The token cache is being invalidate because project 8ca49356486a4f8cbbe46ea6fa4745bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:09.940079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.948282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-b705ed60-51f0-47a5-8434-adcdf39b853b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:09.948282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1394/2737] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:09 2022] DELETE /identity/v3/projects/8ca49356486a4f8cbbe46ea6fa4745bc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:09.949841 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889099-b837-4c53-a08f-b27753e650c6 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:09.950141 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889099-b837-4c53-a08f-b27753e650c6 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:09.950426 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889099-b837-4c53-a08f-b27753e650c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:09.971554 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4f889099-b837-4c53-a08f-b27753e650c6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:09.972824 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4f889099-b837-4c53-a08f-b27753e650c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:10.007697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] The token cache is being invalidate because project 0558825d66c6480aa48f293d4b097916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:10.008150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:10.008890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:10.010684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1344/2738] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:09 2022] DELETE /identity/v3/projects/0558825d66c6480aa48f293d4b097916 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:10.015128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.017660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:10.036311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1395/2739] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:10.043994 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380188-bb87-4da2-8fb3-025c5aebe692 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.044285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380188-bb87-4da2-8fb3-025c5aebe692 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.044696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380188-bb87-4da2-8fb3-025c5aebe692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.071794 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-81380188-bb87-4da2-8fb3-025c5aebe692 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:10.073265 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-81380188-bb87-4da2-8fb3-025c5aebe692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:10.083771 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1396/2740] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:10.087426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1ca91-6c6d-4d9a-9133-4e7a9de9d50c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.087974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380188-bb87-4da2-8fb3-025c5aebe692 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.092243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.093276 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.093568 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.093848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] PATH_INFO: `/v3/users/ab016e0a220246058b39175fce6d27a3` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.095104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab016e0a220246058b39175fce6d27a3)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.097603 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.097963 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380188-bb87-4da2-8fb3-025c5aebe692 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.103815 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.104705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.105176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.105714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.106561 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:16:10.106892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.108625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.122702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1397/2741] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:16:10.127030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.136565 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899b0cf-e905-47b4-acdf-e8edc69da591 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.141115 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.141754 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.142617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.142868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.143548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.145418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.263521 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1398/2742] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:10 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:10.264969 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.269921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:10.317944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab016e0a220246058b39175fce6d27a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:10.330899 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef042a-7841-4cb5-9c76-ff10e46b48ef admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.335743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.336410 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.336679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.336957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.337907 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.339848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.394847 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab016e0a220246058b39175fce6d27a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:10.403200 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab016e0a220246058b39175fce6d27a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:10.403890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab016e0a220246058b39175fce6d27a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:10.404515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab016e0a220246058b39175fce6d27a3'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:10.423134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1345/2743] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:10 2022] DELETE /identity/v3/users/ab016e0a220246058b39175fce6d27a3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:10.456253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1399/2744] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:10 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:10.457438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.458986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:10.478739 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:10.527013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fdd57-0a64-40b0-bfef-c055828a18e0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.531769 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.532445 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.532934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.533224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.533966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.535611 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.547060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1346/2745] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:10.550351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.561386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b50bd-3e11-4f5c-b46a-61dda41607d5 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.567651 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138cc5-6d8b-4160-bdef-19e0c57141ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.568327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138cc5-6d8b-4160-bdef-19e0c57141ca admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.568612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138cc5-6d8b-4160-bdef-19e0c57141ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.568894 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138cc5-6d8b-4160-bdef-19e0c57141ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.569644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06138cc5-6d8b-4160-bdef-19e0c57141ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.571285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06138cc5-6d8b-4160-bdef-19e0c57141ca admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.583123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1400/2746] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:10.587037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.601057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438e0c6-f7d1-454e-be3f-e8fe29b713a5 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.606583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.607532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.607818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.608098 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] PATH_INFO: `/v3/projects/a0a1d425eb374246b1e2121c2cfbac01/users/b5cdedb2e2ee4eaa8abb54acbee32445/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.626032 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a1d425eb374246b1e2121c2cfbac01, user_id=b5cdedb2e2ee4eaa8abb54acbee32445, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.629444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.703644 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1347/2747] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:10 2022] PUT /identity/v3/projects/a0a1d425eb374246b1e2121c2cfbac01/users/b5cdedb2e2ee4eaa8abb54acbee32445/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:10.713947 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc421f-b52a-4e2a-bbcf-e28d79dc1f49 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.714419 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc421f-b52a-4e2a-bbcf-e28d79dc1f49 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.714520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc421f-b52a-4e2a-bbcf-e28d79dc1f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.761274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-f7fc421f-b52a-4e2a-bbcf-e28d79dc1f49 None None] MFA Rules not processed for user `b5cdedb2e2ee4eaa8abb54acbee32445`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:10.762949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f7fc421f-b52a-4e2a-bbcf-e28d79dc1f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:10.846090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.848714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1401/2748] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:10.851971 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:10.854608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc421f-b52a-4e2a-bbcf-e28d79dc1f49 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:10.925703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc421f-b52a-4e2a-bbcf-e28d79dc1f49 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.930502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.931209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.931499 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.931780 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.931896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13f74-2de4-401d-9a56-e25791687a29 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:10.932475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.934861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.936555 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:10.937474 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:10.937763 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:10.938044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] PATH_INFO: `/v3/projects/bea56945f214462b88e9166387937688` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:10.943622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea56945f214462b88e9166387937688)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:10.946186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:10.949875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:11.019840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1402/2749] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:10 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:11.020773 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.082470 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb383b1-d4d6-43c9-938a-726b897cfe7e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.088204 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea56945f214462b88e9166387937688', 'request_id': 'req-6e245ce1-c84d-4120-817d-80e9778db59c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:11.094553 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea56945f214462b88e9166387937688', 'request_id': 'req-6e245ce1-c84d-4120-817d-80e9778db59c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:11.100787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea56945f214462b88e9166387937688', 'request_id': 'req-6e245ce1-c84d-4120-817d-80e9778db59c'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:11.139864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.140540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.140831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.141117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.141805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.143848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.181523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] The token cache is being invalidate because project bea56945f214462b88e9166387937688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:11.181908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:11.182723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-6e245ce1-c84d-4120-817d-80e9778db59c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:11.184785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1348/2750] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:10 2022] DELETE /identity/v3/projects/bea56945f214462b88e9166387937688 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:11.189657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab0ef5-dba7-48b7-9508-ea0519dff244 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.189953 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab0ef5-dba7-48b7-9508-ea0519dff244 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.190238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab0ef5-dba7-48b7-9508-ea0519dff244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.208211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-8eab0ef5-dba7-48b7-9508-ea0519dff244 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:11.209478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8eab0ef5-dba7-48b7-9508-ea0519dff244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:11.217697 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1349/2751] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:11.225963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a920d6f-5a92-4fd9-a180-dd2dfcd04fbc None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.226257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a920d6f-5a92-4fd9-a180-dd2dfcd04fbc None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.226549 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a920d6f-5a92-4fd9-a180-dd2dfcd04fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.231905 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1403/2752] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:11.239868 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.241513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:11.246067 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-5a920d6f-5a92-4fd9-a180-dd2dfcd04fbc None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:11.247268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5a920d6f-5a92-4fd9-a180-dd2dfcd04fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:11.254537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5566-636c-43a4-949c-e90a1930806e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.259324 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1350/2753] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:11.259461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.259974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.260259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.260385 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a920d6f-5a92-4fd9-a180-dd2dfcd04fbc None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.260570 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.261260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.262862 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.265634 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:11.269907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a920d6f-5a92-4fd9-a180-dd2dfcd04fbc None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.274031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.277405 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.277514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1404/2754] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:11.277620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.277620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.277620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:16:11.279420 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.280237 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.281063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.290785 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112351c-a866-4ef5-9f9a-775ed7c5f105 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.293151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1351/2755] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:16:11.296386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.297378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.297550 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.297734 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.298042 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] PATH_INFO: `/v3/projects/70cc931d289f43389f10f1f27464a12a/users/41e7bcb8fdac40eb93b1ea53239ae4f5/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.307622 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223f8e-284e-494d-801a-b9b893d9825c admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.312371 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.313080 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.313368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.313642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.314345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.314463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cc931d289f43389f10f1f27464a12a, user_id=41e7bcb8fdac40eb93b1ea53239ae4f5, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.316414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.317052 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.425807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1405/2756] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:11 2022] PUT /identity/v3/projects/70cc931d289f43389f10f1f27464a12a/users/41e7bcb8fdac40eb93b1ea53239ae4f5/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:11.429599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.462923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1352/2757] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:11.464045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.492588 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:11.496807 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cb30e-e68f-4768-be29-43c8eba8a45f admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.529891 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab9a1f-6b42-4636-8f67-6e19efb4476e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.535681 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.536353 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.536685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.536961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.537652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.539951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.553856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.554530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.554831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.555125 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.555856 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.557450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.567388 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1406/2758] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:11.571358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.581655 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094cbd2-adbf-453c-9bbc-5167f0b01585 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.586505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9043b-0301-42f7-aecd-06d71d2e3db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.587386 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9043b-0301-42f7-aecd-06d71d2e3db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.587675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9043b-0301-42f7-aecd-06d71d2e3db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.587955 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9043b-0301-42f7-aecd-06d71d2e3db3 admin admin] PATH_INFO: `/v3/projects/70cc931d289f43389f10f1f27464a12a/users/41e7bcb8fdac40eb93b1ea53239ae4f5/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.589897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9043b-0301-42f7-aecd-06d71d2e3db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cc931d289f43389f10f1f27464a12a, user_id=41e7bcb8fdac40eb93b1ea53239ae4f5, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.592509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9043b-0301-42f7-aecd-06d71d2e3db3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.603101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1407/2759] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:11 2022] PUT /identity/v3/projects/70cc931d289f43389f10f1f27464a12a/users/41e7bcb8fdac40eb93b1ea53239ae4f5/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:11.614311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.614540 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.614845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.638478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1353/2760] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:11.639820 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.641912 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] MFA Rules not processed for user `41e7bcb8fdac40eb93b1ea53239ae4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:11.643696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:11.651278 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ace082-3a14-4d9b-9dee-875d636ef399 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.708839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.709513 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.709803 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.710085 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.710854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.712443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.713762 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1408/2761] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:11.723037 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1354/2762] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:11.725633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.728281 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.728420 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:11.738522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a2c2-c730-46d5-9a00-7a96c7d6106e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.743176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.748164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.748164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.748164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.748164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.748164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.757100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1355/2763] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:11.761115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.771563 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cf9e-1033-4445-b7e7-da28a447d487 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.776403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.777399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.780150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.780150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] PATH_INFO: `/v3/projects/5db467655d3447e2952b0c474f4f99af/users/7cf646f3de0d4ec799e9126672173cfc/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.785921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79513fb8-95d2-46d8-8e63-e1bf19e1d60d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.789753 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c0cea-6665-4cca-bdf8-0d1265996ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.790406 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0cea-6665-4cca-bdf8-0d1265996ffc service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.790693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0cea-6665-4cca-bdf8-0d1265996ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.791047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c0cea-6665-4cca-bdf8-0d1265996ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.793018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db467655d3447e2952b0c474f4f99af, user_id=7cf646f3de0d4ec799e9126672173cfc, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.795875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.800492 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c0cea-6665-4cca-bdf8-0d1265996ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:11.801928 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c0cea-6665-4cca-bdf8-0d1265996ffc service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:11.811536 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1409/2764] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:11.883048 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1356/2765] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:11 2022] PUT /identity/v3/projects/5db467655d3447e2952b0c474f4f99af/users/7cf646f3de0d4ec799e9126672173cfc/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:11.895078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224fab1-2032-42db-8da0-c4b3c84e9bd4 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.895997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224fab1-2032-42db-8da0-c4b3c84e9bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.896290 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224fab1-2032-42db-8da0-c4b3c84e9bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.914151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:11.923390 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-4224fab1-2032-42db-8da0-c4b3c84e9bd4 None None] MFA Rules not processed for user `7cf646f3de0d4ec799e9126672173cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:11.924654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4224fab1-2032-42db-8da0-c4b3c84e9bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:11.928806 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:11.934696 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:11.970205 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce071-ee6e-432d-a60f-01ee79b707bb admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:11.973849 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:11.974526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:11.974974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:11.975262 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:11.977068 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:11.991391 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1410/2766] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:11.995603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224fab1-2032-42db-8da0-c4b3c84e9bd4 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.037480 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.039759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.052124 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1357/2767] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:16:12.052784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.054083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:12.059937 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224fab1-2032-42db-8da0-c4b3c84e9bd4 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.067153 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.067827 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.068060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18a2d7-31fc-4ab4-a91f-f6ac025d0912 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.068167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.068387 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.069093 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.072715 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.072874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.073581 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.073872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.074147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] PATH_INFO: `/v3/users/01940c2ed024495d88541ca830b4d391` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.075774 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01940c2ed024495d88541ca830b4d391)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.081501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.162845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1411/2768] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:11 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:12.166454 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.236727 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f1da-4d64-4c1d-986f-4a26d5f56b60 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.241571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.242278 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.242566 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.242871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.243602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.245538 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.281173 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01940c2ed024495d88541ca830b4d391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:12.317679 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1412/2769] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:12 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:12.321903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.328104 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01940c2ed024495d88541ca830b4d391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:12.332309 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7e7d-391b-4148-a3af-f558b3ece2d8 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.335867 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01940c2ed024495d88541ca830b4d391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:12.336530 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01940c2ed024495d88541ca830b4d391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:12.337183 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-59b3506f-5d88-428a-98ab-86b4f74eaeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01940c2ed024495d88541ca830b4d391'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:12.337316 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.337904 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.338193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.338474 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.339215 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.340792 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.350923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1413/2770] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:12.355822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.360166 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:12.367216 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1358/2771] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:12 2022] DELETE /identity/v3/users/01940c2ed024495d88541ca830b4d391 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:12.371655 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.372171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.372450 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.374486 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fab35a-1faa-4234-8fa7-4d7c8f262369 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.383095 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:12.392118 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:12.393325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:12.441587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:12.445191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.446102 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.446502 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.446843 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] PATH_INFO: `/v3/projects/57a7663f0cf84de1baa7aaf18b66f720/users/0b9558a95832428fa7eb24e7c711e535/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.460310 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1359/2772] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:12.461151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a7663f0cf84de1baa7aaf18b66f720, user_id=0b9558a95832428fa7eb24e7c711e535, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.464343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.469874 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.471783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:12.528677 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f3c8a-2056-4082-82a6-809a7ac3b688 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.532524 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.533729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.534007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.534288 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.543588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.548954 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.555130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1360/2773] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:12.556497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.558529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:12.574615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1414/2774] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:12 2022] PUT /identity/v3/projects/57a7663f0cf84de1baa7aaf18b66f720/users/0b9558a95832428fa7eb24e7c711e535/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:12.576728 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc2529-45d9-411d-bfc2-e47cc9ebb1d3 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.578656 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.640460 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.641366 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.641652 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.641932 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] PATH_INFO: `/v3/users/b5cdedb2e2ee4eaa8abb54acbee32445` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.643394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cdedb2e2ee4eaa8abb54acbee32445)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.646040 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.769537 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e237a-6c00-4715-b371-7daaf2775fc7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.774737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.775428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.775711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.775983 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.776703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.778269 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.788667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1415/2775] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:12.792645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.802450 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105e3e7-65cc-49ee-9715-640f01304294 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:12.807302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97312c0-c575-44b2-88bc-b7fe24576db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:12.808120 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97312c0-c575-44b2-88bc-b7fe24576db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.808401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97312c0-c575-44b2-88bc-b7fe24576db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.808703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97312c0-c575-44b2-88bc-b7fe24576db0 admin admin] PATH_INFO: `/v3/projects/57a7663f0cf84de1baa7aaf18b66f720/users/0b9558a95832428fa7eb24e7c711e535/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.810603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97312c0-c575-44b2-88bc-b7fe24576db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a7663f0cf84de1baa7aaf18b66f720, user_id=0b9558a95832428fa7eb24e7c711e535, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:12.813243 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97312c0-c575-44b2-88bc-b7fe24576db0 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:12.823062 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1416/2776] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:12 2022] PUT /identity/v3/projects/57a7663f0cf84de1baa7aaf18b66f720/users/0b9558a95832428fa7eb24e7c711e535/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:12.833545 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:12.833831 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:12.840581 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:12.859985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] MFA Rules not processed for user `0b9558a95832428fa7eb24e7c711e535`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:12.861203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:12.916487 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cdedb2e2ee4eaa8abb54acbee32445'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:12.928116 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:12.931645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1417/2777] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:12.935323 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:12.936635 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:12.996976 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cdedb2e2ee4eaa8abb54acbee32445'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:12.997599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156816d-c7bb-45e0-878d-618bccb0c3f2 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.002268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.003148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.003428 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.013059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] PATH_INFO: `/v3/projects/f6349c1f0e374b0b87f64a45509f2660` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.013196 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cdedb2e2ee4eaa8abb54acbee32445'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.013299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6349c1f0e374b0b87f64a45509f2660)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.013417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cdedb2e2ee4eaa8abb54acbee32445'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.013417 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cdedb2e2ee4eaa8abb54acbee32445'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.013609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.024376 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1361/2778] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:12 2022] DELETE /identity/v3/users/b5cdedb2e2ee4eaa8abb54acbee32445 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:13.027585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.027585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.037709 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:13.082996 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94434e38-a99a-4e4f-8cb7-1241c07ec1d9 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.086846 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0716b52-0225-48c8-bfff-a08a77be3081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.087501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716b52-0225-48c8-bfff-a08a77be3081 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.087785 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716b52-0225-48c8-bfff-a08a77be3081 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.088059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716b52-0225-48c8-bfff-a08a77be3081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.089800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f0716b52-0225-48c8-bfff-a08a77be3081 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.122694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6349c1f0e374b0b87f64a45509f2660', 'request_id': 'req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.129067 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6349c1f0e374b0b87f64a45509f2660', 'request_id': 'req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.134743 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6349c1f0e374b0b87f64a45509f2660', 'request_id': 'req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.152340 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0716b52-0225-48c8-bfff-a08a77be3081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.153796 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0716b52-0225-48c8-bfff-a08a77be3081 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.164565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1362/2779] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:13.165888 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.166178 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.166459 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.183090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:13.184334 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.202527 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] The token cache is being invalidate because project f6349c1f0e374b0b87f64a45509f2660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:13.203110 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.206302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e1a888a6-3bab-4b8d-9c10-10571e9f2b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:13.206302 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1418/2780] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:12 2022] DELETE /identity/v3/projects/f6349c1f0e374b0b87f64a45509f2660 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:13.210908 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.211203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.211507 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.229749 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:13.231312 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.252257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1363/2781] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:13.253360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.254682 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.291980 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1419/2782] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:13.292959 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.294327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.316490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafaf30-5f8e-455e-b7d6-eb4b193fdf1e None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.320259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.320905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.321193 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.321471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.323315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.327803 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:13.336884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=100 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:13.351817 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a605c-736c-47bc-a80d-ac533f0e6810 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.356253 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072e07-2937-4cdd-b460-e963557931b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.357033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072e07-2937-4cdd-b460-e963557931b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.357372 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072e07-2937-4cdd-b460-e963557931b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.357669 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072e07-2937-4cdd-b460-e963557931b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.367789 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072e07-2937-4cdd-b460-e963557931b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.369216 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072e07-2937-4cdd-b460-e963557931b9 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.379129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1420/2783] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:13.380359 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433749ef-9fe8-4e71-9ee4-a9dcf6b30a20 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.380642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433749ef-9fe8-4e71-9ee4-a9dcf6b30a20 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.381021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433749ef-9fe8-4e71-9ee4-a9dcf6b30a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.384658 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.386100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.398523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1364/2784] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:13.400648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-433749ef-9fe8-4e71-9ee4-a9dcf6b30a20 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:13.402236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-433749ef-9fe8-4e71-9ee4-a9dcf6b30a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.412992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1421/2785] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:13.417384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.429680 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef880-0c16-4558-b5f3-034498a15c72 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.434958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.435695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.435986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.436270 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.437035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:16:13.437483 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.439508 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.453479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1365/2786] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:16:13.459368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433749ef-9fe8-4e71-9ee4-a9dcf6b30a20 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.468787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433749ef-9fe8-4e71-9ee4-a9dcf6b30a20 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.474680 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.475509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.475755 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.476053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.476842 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.478870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.577183 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1422/2787] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:13 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:13.581505 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.593184 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bedf40-c1bd-436d-98d4-ae34484674ec admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.660383 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.664862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.664862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.664862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.664862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.664862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.860231 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1366/2788] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:13 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:13.861910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.864564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.864710 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.878854 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268262-7068-437c-b49d-3368e11a57fd admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.884058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.884224 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99b69-7735-4b84-98df-f0c31ef3fd81 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.884765 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.885259 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.885608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] PATH_INFO: `/v3/projects/a0a1d425eb374246b1e2121c2cfbac01` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.887136 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a1d425eb374246b1e2121c2cfbac01)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.889100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.889526 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.889777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.889992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.890269 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.891040 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.894311 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.903962 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1367/2789] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:13.907959 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.919667 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a879-deec-4b85-afa3-ffb750681f1e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.924981 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.925653 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.926072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.926252 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.927128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.928731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.940341 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1368/2790] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:13.944556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.954256 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572673-f0f8-4b33-989a-da9067f86a5f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.958947 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598572fa-2a75-4f80-a97d-a20ec1b2557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.959801 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598572fa-2a75-4f80-a97d-a20ec1b2557f admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.960087 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598572fa-2a75-4f80-a97d-a20ec1b2557f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.960368 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598572fa-2a75-4f80-a97d-a20ec1b2557f admin admin] PATH_INFO: `/v3/projects/ab56980ec2ec46a9ac6c1834584a7b56/users/0a81de6762c94b1ca32a7268d3ae8657/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.975415 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598572fa-2a75-4f80-a97d-a20ec1b2557f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab56980ec2ec46a9ac6c1834584a7b56, user_id=0a81de6762c94b1ca32a7268d3ae8657, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.978171 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598572fa-2a75-4f80-a97d-a20ec1b2557f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:14.065759 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1369/2791] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:13 2022] PUT /identity/v3/projects/ab56980ec2ec46a9ac6c1834584a7b56/users/0a81de6762c94b1ca32a7268d3ae8657/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:14.084519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a1d425eb374246b1e2121c2cfbac01', 'request_id': 'req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.091835 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a1d425eb374246b1e2121c2cfbac01', 'request_id': 'req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.099611 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a1d425eb374246b1e2121c2cfbac01', 'request_id': 'req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.131279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:14.131618 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:14.131904 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:14.165214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] MFA Rules not processed for user `0a81de6762c94b1ca32a7268d3ae8657`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:14.165214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:14.188851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] The token cache is being invalidate because project a0a1d425eb374246b1e2121c2cfbac01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:14.189260 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.189923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.191660 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1423/2792] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:13 2022] DELETE /identity/v3/projects/a0a1d425eb374246b1e2121c2cfbac01 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:14.195644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:14.196942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:14.198545 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:14.231293 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1370/2793] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:14.243259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:14.244704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:14.262185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c18a3f-c4d3-421c-a0ff-f68f31d7ee54 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:14.297438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:14.308875 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b9a8d-af3c-47c9-b96a-358ccb05b80c None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:14.312684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:14.313273 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:14.313558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:14.313861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:14.321348 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:14.322112 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:14.322232 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:14.322484 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:14.322760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] PATH_INFO: `/v3/users/41e7bcb8fdac40eb93b1ea53239ae4f5` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:14.323561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:14.323970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e7bcb8fdac40eb93b1ea53239ae4f5)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:14.325845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:14.333268 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1371/2794] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:16:14.522597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e7bcb8fdac40eb93b1ea53239ae4f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.537123 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e7bcb8fdac40eb93b1ea53239ae4f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.538277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e7bcb8fdac40eb93b1ea53239ae4f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.538934 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e7bcb8fdac40eb93b1ea53239ae4f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.554850 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-e2fe9abb-466d-4ddd-8c0f-8525a5a8179f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e7bcb8fdac40eb93b1ea53239ae4f5'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:14.629152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1424/2795] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:14 2022] DELETE /identity/v3/users/41e7bcb8fdac40eb93b1ea53239ae4f5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:15.128929 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:15.143060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328f1e1-5ffa-4379-a2e1-778bcf7586c5 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:15.212234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:15.213350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:15.213551 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:15.213823 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] PATH_INFO: `/v3/projects/70cc931d289f43389f10f1f27464a12a` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:15.215064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cc931d289f43389f10f1f27464a12a)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:15.218495 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:15.386125 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cc931d289f43389f10f1f27464a12a', 'request_id': 'req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:15.392307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cc931d289f43389f10f1f27464a12a', 'request_id': 'req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:15.398034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cc931d289f43389f10f1f27464a12a', 'request_id': 'req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:15.488448 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] The token cache is being invalidate because project 70cc931d289f43389f10f1f27464a12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:15.488988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:15.489795 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-90e4bf6a-7c73-4f75-a757-a4e2e13762d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:15.491452 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1372/2796] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:15 2022] DELETE /identity/v3/projects/70cc931d289f43389f10f1f27464a12a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:15.496448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8888c5-f6d3-4473-bf01-e333833845cb None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:15.501797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8888c5-f6d3-4473-bf01-e333833845cb None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:15.501797 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8888c5-f6d3-4473-bf01-e333833845cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:15.515480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8f8888c5-f6d3-4473-bf01-e333833845cb None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:15.521114 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8f8888c5-f6d3-4473-bf01-e333833845cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:15.579892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1425/2797] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:15.588060 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe964-ffc8-4e6b-b742-ce28d248ba45 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:15.591490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe964-ffc8-4e6b-b742-ce28d248ba45 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:15.591490 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fe964-ffc8-4e6b-b742-ce28d248ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:15.602127 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:15.608514 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f80fe964-ffc8-4e6b-b742-ce28d248ba45 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:15.609993 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f80fe964-ffc8-4e6b-b742-ce28d248ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:15.619115 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1373/2798] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:15.623452 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8888c5-f6d3-4473-bf01-e333833845cb None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:15.633885 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8888c5-f6d3-4473-bf01-e333833845cb None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:15.639033 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:15.639709 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:15.639996 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:15.640271 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:15.641045 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:16:15.641453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:15.643126 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:15.658706 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1426/2799] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:16:15.660010 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fe964-ffc8-4e6b-b742-ce28d248ba45 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:15.669943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fe964-ffc8-4e6b-b742-ce28d248ba45 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:15.675815 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:15.676567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:15.676945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:15.677303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:15.678004 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:15.679951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:15.801872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1374/2800] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:15 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:15.802915 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:15.812740 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe36335-da4e-4bf6-8a77-3d351b552921 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:15.858079 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:15.874389 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:15.875170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:15.875614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:15.875931 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:15.876638 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:15.878548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:15.963204 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1427/2801] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:15 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:15.967257 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:15.978272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599dd6-f096-4375-9157-549d33d20d74 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:15.992855 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:15.993535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:15.993822 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:15.997377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:15.997377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:15.997377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.012407 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1375/2802] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:16.020840 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.026048 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a355-c8b9-4c29-907a-55ae93e70922 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.031726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c996ce8-2456-4c02-bea1-1a8d7128b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.033617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996ce8-2456-4c02-bea1-1a8d7128b1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.034111 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996ce8-2456-4c02-bea1-1a8d7128b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.034394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996ce8-2456-4c02-bea1-1a8d7128b1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.035203 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c996ce8-2456-4c02-bea1-1a8d7128b1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.037073 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c996ce8-2456-4c02-bea1-1a8d7128b1ba admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.048211 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1428/2803] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:16.052493 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.065137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51638997-4a67-42e0-baf5-29025ec04ac3 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.069729 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.070637 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.070951 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.071249 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] PATH_INFO: `/v3/projects/c3c8f12c9f784ce486ba3a339917428f/users/c8079a05729b4c58a01ba8f8c2a93fa5/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.085866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c8f12c9f784ce486ba3a339917428f, user_id=c8079a05729b4c58a01ba8f8c2a93fa5, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.088567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.171587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1376/2804] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:16 2022] PUT /identity/v3/projects/c3c8f12c9f784ce486ba3a339917428f/users/c8079a05729b4c58a01ba8f8c2a93fa5/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:16.192471 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67dfdf-7c2e-4bd6-a329-bb9fafcc0185 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.192958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67dfdf-7c2e-4bd6-a329-bb9fafcc0185 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.193424 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67dfdf-7c2e-4bd6-a329-bb9fafcc0185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.226646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2e67dfdf-7c2e-4bd6-a329-bb9fafcc0185 None None] MFA Rules not processed for user `c8079a05729b4c58a01ba8f8c2a93fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:16.227896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2e67dfdf-7c2e-4bd6-a329-bb9fafcc0185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:16.292030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1429/2805] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:16.296503 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.361485 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12338a-1f3b-4d7e-a451-123d70d65e09 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.366002 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.366664 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.366991 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.367271 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.367974 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.369914 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.459410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1377/2806] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:16 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:16.463855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67dfdf-7c2e-4bd6-a329-bb9fafcc0185 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.474555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67dfdf-7c2e-4bd6-a329-bb9fafcc0185 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.530206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.531037 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.531193 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.531475 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.532212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.534148 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.671505 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1430/2807] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:16 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:16.676059 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.690274 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7db3f-209b-47f1-8871-87ace8d1c464 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.694979 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.695938 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.696426 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.696810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.697706 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.699604 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.715088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1378/2808] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:16:16.718787 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.726666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebadaee-5fac-4fd0-ba1f-063666b463ad admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.731599 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.732463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.732742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.733017 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] PATH_INFO: `/v3/projects/da6766987c2340f9bf91cf66ef2669db/users/abc9b148fae8477593f67c9b42fa9c40/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.747667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6766987c2340f9bf91cf66ef2669db, user_id=abc9b148fae8477593f67c9b42fa9c40, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.750268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.837140 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1431/2809] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:16 2022] PUT /identity/v3/projects/da6766987c2340f9bf91cf66ef2669db/users/abc9b148fae8477593f67c9b42fa9c40/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:16.842430 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.856685 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e30b3-2ba4-442a-b90b-b83a497b8d0e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.924737 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09d688-5bda-4154-a4df-0cee0a18cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.925411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09d688-5bda-4154-a4df-0cee0a18cdcb admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.925810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09d688-5bda-4154-a4df-0cee0a18cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.926019 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09d688-5bda-4154-a4df-0cee0a18cdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.926906 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09d688-5bda-4154-a4df-0cee0a18cdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.928786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09d688-5bda-4154-a4df-0cee0a18cdcb admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.941108 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1379/2810] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:16.945218 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:16.956567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18055257-36be-4211-9ae7-7663575bce54 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:16.963184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:16.964602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.965032 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.965407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] PATH_INFO: `/v3/projects/da6766987c2340f9bf91cf66ef2669db/users/abc9b148fae8477593f67c9b42fa9c40/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:16.967888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6766987c2340f9bf91cf66ef2669db, user_id=abc9b148fae8477593f67c9b42fa9c40, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:16.971461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:16.983358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1432/2811] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:16 2022] PUT /identity/v3/projects/da6766987c2340f9bf91cf66ef2669db/users/abc9b148fae8477593f67c9b42fa9c40/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:16.996073 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:16.996362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:16.996642 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:17.020009 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:17.022890 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] MFA Rules not processed for user `abc9b148fae8477593f67c9b42fa9c40`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:17.024090 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:17.089424 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1380/2812] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:17.100950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:17.102708 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:17.156439 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:17.160567 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249957-cdeb-4b9a-95a2-75cf94f53ff3 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:17.164319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683dac1-c2d4-4bc4-a035-1e569a4ca0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:17.164957 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683dac1-c2d4-4bc4-a035-1e569a4ca0fc service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:17.165242 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683dac1-c2d4-4bc4-a035-1e569a4ca0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:17.165520 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683dac1-c2d4-4bc4-a035-1e569a4ca0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:17.220791 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683dac1-c2d4-4bc4-a035-1e569a4ca0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:17.222133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683dac1-c2d4-4bc4-a035-1e569a4ca0fc service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:17.231192 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1433/2813] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:21.456169 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:21.457630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:21.521675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c5b1-ca77-4c12-a1f9-38b1afa7d0bf None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:21.526107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:21.526989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:21.527275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:21.527548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] PATH_INFO: `/v3/users/7cf646f3de0d4ec799e9126672173cfc` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:21.528712 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf646f3de0d4ec799e9126672173cfc)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:21.530627 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:21.717567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf646f3de0d4ec799e9126672173cfc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:21.777839 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf646f3de0d4ec799e9126672173cfc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:21.785944 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf646f3de0d4ec799e9126672173cfc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:21.788574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf646f3de0d4ec799e9126672173cfc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:21.788574 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf646f3de0d4ec799e9126672173cfc'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:21.804958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1381/2814] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:21 2022] DELETE /identity/v3/users/7cf646f3de0d4ec799e9126672173cfc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:21.809328 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:21.809822 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:21.809943 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:21.826756 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:21.827977 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:21.886449 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1434/2815] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:21.899017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:21.905967 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:21.923035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:21.960882 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417cee-fe44-4c48-8940-9b5ce07b40a9 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:21.965167 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:21.965811 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:21.966116 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:21.966377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:21.975837 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:21.977267 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:21.987260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1382/2816] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:22.380496 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:22.381128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:22.402165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4b271-fde7-4ddd-94f8-545fe9561e7f None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:22.407834 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:22.408703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:22.408987 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:22.409261 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] PATH_INFO: `/v3/projects/5db467655d3447e2952b0c474f4f99af` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:22.410601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db467655d3447e2952b0c474f4f99af)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:22.412532 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:22.538627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db467655d3447e2952b0c474f4f99af', 'request_id': 'req-3ab11989-0422-4c12-be06-347fda8ac846'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.540522 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:22.545035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db467655d3447e2952b0c474f4f99af', 'request_id': 'req-3ab11989-0422-4c12-be06-347fda8ac846'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.551176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db467655d3447e2952b0c474f4f99af', 'request_id': 'req-3ab11989-0422-4c12-be06-347fda8ac846'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.651661 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] The token cache is being invalidate because project 5db467655d3447e2952b0c474f4f99af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:22.651900 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.652535 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.654257 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1435/2817] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:22 2022] DELETE /identity/v3/projects/5db467655d3447e2952b0c474f4f99af => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:22.658945 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:22.668535 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d13309-ebf8-4707-a18c-060a54fa6847 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:22.724346 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:22.725209 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:22.725526 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:22.725807 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] PATH_INFO: `/v3/users/0b9558a95832428fa7eb24e7c711e535` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:22.727057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9558a95832428fa7eb24e7c711e535)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:22.729017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:22.883963 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9558a95832428fa7eb24e7c711e535'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.962423 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9558a95832428fa7eb24e7c711e535'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.970401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9558a95832428fa7eb24e7c711e535'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.971093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9558a95832428fa7eb24e7c711e535'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.976017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-0eebf887-4b41-4800-b9f8-9b581cc86efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9558a95832428fa7eb24e7c711e535'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:22.989027 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1383/2818] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:22 2022] DELETE /identity/v3/users/0b9558a95832428fa7eb24e7c711e535 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:23.390633 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:23.392202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:23.407509 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11989-0422-4c12-be06-347fda8ac846 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:23.464901 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:23.465694 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:23.465978 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:23.466258 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] PATH_INFO: `/v3/projects/57a7663f0cf84de1baa7aaf18b66f720` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:23.467453 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a7663f0cf84de1baa7aaf18b66f720)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:23.469332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:23.573881 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a7663f0cf84de1baa7aaf18b66f720', 'request_id': 'req-3da0332e-a7cb-43c7-b378-526cb0ae33c8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:23.580063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a7663f0cf84de1baa7aaf18b66f720', 'request_id': 'req-3da0332e-a7cb-43c7-b378-526cb0ae33c8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:23.585584 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a7663f0cf84de1baa7aaf18b66f720', 'request_id': 'req-3da0332e-a7cb-43c7-b378-526cb0ae33c8'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:23.674516 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] The token cache is being invalidate because project 57a7663f0cf84de1baa7aaf18b66f720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:23.674805 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:23.675478 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-3da0332e-a7cb-43c7-b378-526cb0ae33c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:23.677031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1436/2819] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:23 2022] DELETE /identity/v3/projects/57a7663f0cf84de1baa7aaf18b66f720 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:23.682607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1fdf-e752-4f7f-a93e-6cfbc4cfb9aa None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:23.683134 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1fdf-e752-4f7f-a93e-6cfbc4cfb9aa None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:23.683238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1fdf-e752-4f7f-a93e-6cfbc4cfb9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:23.701905 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-edbe1fdf-e752-4f7f-a93e-6cfbc4cfb9aa None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:23.703153 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-edbe1fdf-e752-4f7f-a93e-6cfbc4cfb9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:23.736773 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:23.760783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1384/2820] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:23.768378 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71539b-6de5-47ae-b331-d1f77c766104 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:23.768674 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71539b-6de5-47ae-b331-d1f77c766104 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:23.768960 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71539b-6de5-47ae-b331-d1f77c766104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:23.787591 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-6f71539b-6de5-47ae-b331-d1f77c766104 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:23.788781 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-6f71539b-6de5-47ae-b331-d1f77c766104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:23.797065 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1437/2821] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:23.801838 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe1fdf-e752-4f7f-a93e-6cfbc4cfb9aa None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:23.811284 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe1fdf-e752-4f7f-a93e-6cfbc4cfb9aa None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:23.815970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:23.816616 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:23.816897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:23.817176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] PATH_INFO: `/v3/domains` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:23.817896 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:16:23.818201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:23.819808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:23.832070 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1385/2822] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:16:23.836310 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71539b-6de5-47ae-b331-d1f77c766104 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:23.846075 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71539b-6de5-47ae-b331-d1f77c766104 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:23.850597 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:23.851282 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:23.851571 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:23.851855 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:23.852555 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:23.854438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:23.933360 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1438/2823] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:23 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:23.937589 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:23.947687 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86b32-74a5-4343-80ab-dccbc04b395f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:24.007042 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:24.007744 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:24.008036 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:24.008320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:24.009064 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:24.011013 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:24.097148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1386/2824] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:23 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:24.099080 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:24.110007 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a91e7-6af0-4885-8305-0d5d133e950d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:24.114802 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:24.115628 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:24.115923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:24.116202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:24.116930 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:24.118515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:24.129170 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1439/2825] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:24.133434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:24.144285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afc7c-0de2-412e-be3e-c58902ee134b admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:24.149320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ced3ab-7db4-4490-ab56-f52aab90a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:24.150038 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced3ab-7db4-4490-ab56-f52aab90a237 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:24.150325 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced3ab-7db4-4490-ab56-f52aab90a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:24.150727 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced3ab-7db4-4490-ab56-f52aab90a237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:24.151529 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ced3ab-7db4-4490-ab56-f52aab90a237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:24.153129 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ced3ab-7db4-4490-ab56-f52aab90a237 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:24.164286 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1387/2826] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:24.168578 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:24.178673 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e200a0b-d514-41a0-8e4d-30da2a1645a1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:24.183514 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:24.184399 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:24.184700 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:24.184970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] PATH_INFO: `/v3/projects/0a3ef9e4d3804f5e8d1cea6c7205796e/users/61dbc07320584d8f8fcc71f7e745b5e7/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:24.200632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3ef9e4d3804f5e8d1cea6c7205796e, user_id=61dbc07320584d8f8fcc71f7e745b5e7, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:24.205225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:24.277144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1440/2827] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:24 2022] PUT /identity/v3/projects/0a3ef9e4d3804f5e8d1cea6c7205796e/users/61dbc07320584d8f8fcc71f7e745b5e7/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:24.282122 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:24.282438 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:24.282735 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:24.300695 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:24.305845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:24.363403 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1388/2828] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:24.372953 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:24.375035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:24.385451 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:24.406203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:24.407790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:24.440077 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033726-2601-4deb-8aa6-37c588e5292a admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:24.443823 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15729cd5-2e21-4690-a956-7b630a59fb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:24.444472 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729cd5-2e21-4690-a956-7b630a59fb30 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:24.444759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729cd5-2e21-4690-a956-7b630a59fb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:24.445038 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729cd5-2e21-4690-a956-7b630a59fb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:24.454089 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15729cd5-2e21-4690-a956-7b630a59fb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:24.455546 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15729cd5-2e21-4690-a956-7b630a59fb30 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:24.460444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:24.465477 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1441/2829] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:24.466234 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383dd77-8cf9-4e93-86ec-007ad596d4a0 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:24.470704 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:24.472093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:24.472093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:24.472093 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:24.473842 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:24.540237 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:24.540414 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:24.551756 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1389/2830] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:16:25.696921 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5f354-fccc-41c8-9a87-3a37a295c2d8 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:25.697480 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5f354-fccc-41c8-9a87-3a37a295c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:25.697606 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5f354-fccc-41c8-9a87-3a37a295c2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:25.769896 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9fd5f354-fccc-41c8-9a87-3a37a295c2d8 None None] MFA Rules not processed for user `61dbc07320584d8f8fcc71f7e745b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:25.771164 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9fd5f354-fccc-41c8-9a87-3a37a295c2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:25.838248 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1442/2831] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:25.850147 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:25.851578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:25.863008 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c9559-cb58-43c8-8170-fd969cac7ab2 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:25.866606 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:25.867287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:25.867576 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:25.867859 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:25.876259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:25.877684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:25.886933 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1390/2832] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:29.649644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1a24-54a7-4829-867e-3c6324d56b2b None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:29.650133 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1a24-54a7-4829-867e-3c6324d56b2b None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:29.650256 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1a24-54a7-4829-867e-3c6324d56b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:29.671224 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e27e1a24-54a7-4829-867e-3c6324d56b2b None None] MFA Rules not processed for user `61dbc07320584d8f8fcc71f7e745b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:29.673933 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e27e1a24-54a7-4829-867e-3c6324d56b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:29.681330 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1443/2833] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:32.493501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:32.494923 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:32.508254 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c0654-4443-4593-98fb-826c1a7867f2 service cinder] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:32.513660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:32.514534 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:32.514843 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:32.515128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] PATH_INFO: `/v3/users/c8079a05729b4c58a01ba8f8c2a93fa5` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:32.516328 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8079a05729b4c58a01ba8f8c2a93fa5)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:32.518392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:32.885884 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8079a05729b4c58a01ba8f8c2a93fa5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:32.956912 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8079a05729b4c58a01ba8f8c2a93fa5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:32.965136 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8079a05729b4c58a01ba8f8c2a93fa5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:32.965845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8079a05729b4c58a01ba8f8c2a93fa5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:32.966538 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8079a05729b4c58a01ba8f8c2a93fa5'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:32.985584 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1391/2834] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:32 2022] DELETE /identity/v3/users/c8079a05729b4c58a01ba8f8c2a93fa5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:32.990637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:32.994551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:32.994551 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:33.009733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:33.010982 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:33.070407 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1444/2835] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:33.079741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:33.081408 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:33.142412 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44606bd8-7b21-46f0-974d-b6e03cd5c54e admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:33.146258 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:33.146943 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:33.147230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:33.147502 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:33.157853 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:33.159556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:33.163588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:33.169911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1392/2836] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:33.773463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:33.781030 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:33.789730 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18670fbb-0332-40e0-984d-568f34c960fd None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:33.795394 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:33.796339 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:33.796517 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:33.796886 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] PATH_INFO: `/v3/projects/c3c8f12c9f784ce486ba3a339917428f` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:33.798020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c8f12c9f784ce486ba3a339917428f)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:33.804440 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:33.918235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:33.933405 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c8f12c9f784ce486ba3a339917428f', 'request_id': 'req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:33.940678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c8f12c9f784ce486ba3a339917428f', 'request_id': 'req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:33.946736 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c8f12c9f784ce486ba3a339917428f', 'request_id': 'req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.073061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] The token cache is being invalidate because project c3c8f12c9f784ce486ba3a339917428f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:34.073061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.073061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.073061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1445/2837] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:33 2022] DELETE /identity/v3/projects/c3c8f12c9f784ce486ba3a339917428f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:34.074214 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:34.088017 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a31e1-6474-446c-9f49-6789bd02185b service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:34.151791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:34.152672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:34.152961 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:34.153243 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] PATH_INFO: `/v3/users/abc9b148fae8477593f67c9b42fa9c40` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:34.154482 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc9b148fae8477593f67c9b42fa9c40)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:34.156587 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:34.297848 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc9b148fae8477593f67c9b42fa9c40'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.378100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc9b148fae8477593f67c9b42fa9c40'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.387949 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc9b148fae8477593f67c9b42fa9c40'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.388861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc9b148fae8477593f67c9b42fa9c40'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.389516 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc9b148fae8477593f67c9b42fa9c40'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:34.411312 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1393/2838] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:34 2022] DELETE /identity/v3/users/abc9b148fae8477593f67c9b42fa9c40 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:35.010714 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.012333 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:35.025645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb22f7d-9bc5-4d27-a01b-e38986279ecb admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.088757 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.089621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.089903 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.090184 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] PATH_INFO: `/v3/projects/da6766987c2340f9bf91cf66ef2669db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.091413 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6766987c2340f9bf91cf66ef2669db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.093329 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.139786 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.141320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:35.156462 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf00c-57f1-4c91-a85d-cf495fbd9d87 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.161190 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.162003 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.162287 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.162609 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] PATH_INFO: `/v3/users/0a81de6762c94b1ca32a7268d3ae8657` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.163869 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a81de6762c94b1ca32a7268d3ae8657)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.165780 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.210751 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6766987c2340f9bf91cf66ef2669db', 'request_id': 'req-f6ef103f-2eff-4c0b-ad49-439b63437cab'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.216866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6766987c2340f9bf91cf66ef2669db', 'request_id': 'req-f6ef103f-2eff-4c0b-ad49-439b63437cab'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.222461 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6766987c2340f9bf91cf66ef2669db', 'request_id': 'req-f6ef103f-2eff-4c0b-ad49-439b63437cab'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.355358 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] The token cache is being invalidate because project da6766987c2340f9bf91cf66ef2669db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:35.355938 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.356589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-f6ef103f-2eff-4c0b-ad49-439b63437cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.358400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1446/2839] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:35 2022] DELETE /identity/v3/projects/da6766987c2340f9bf91cf66ef2669db => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:35.364813 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddba412-188e-4dda-954a-e2904c4a3257 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.365563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddba412-188e-4dda-954a-e2904c4a3257 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.365563 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddba412-188e-4dda-954a-e2904c4a3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.386939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-9ddba412-188e-4dda-954a-e2904c4a3257 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:35.388314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9ddba412-188e-4dda-954a-e2904c4a3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:35.389831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a81de6762c94b1ca32a7268d3ae8657'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.432866 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:35.452479 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1447/2840] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:35.453989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a81de6762c94b1ca32a7268d3ae8657'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.460992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da5e7c-b03f-4d46-b347-6a36ca2150d3 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.461296 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da5e7c-b03f-4d46-b347-6a36ca2150d3 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.461637 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da5e7c-b03f-4d46-b347-6a36ca2150d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.462812 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a81de6762c94b1ca32a7268d3ae8657'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.463657 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a81de6762c94b1ca32a7268d3ae8657'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.464294 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-91e88880-0d7a-4254-88b9-41c921140239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a81de6762c94b1ca32a7268d3ae8657'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:35.472910 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:35.480226 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e9da5e7c-b03f-4d46-b347-6a36ca2150d3 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:35.482128 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e9da5e7c-b03f-4d46-b347-6a36ca2150d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:35.486018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1394/2841] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:35 2022] DELETE /identity/v3/users/0a81de6762c94b1ca32a7268d3ae8657 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:35.490871 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.491021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.491479 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.493776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1448/2842] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:35.494711 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da5e7c-b03f-4d46-b347-6a36ca2150d3 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.503750 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da5e7c-b03f-4d46-b347-6a36ca2150d3 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.510926 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:35.516072 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:35.570617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.571315 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.571675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.571860 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.572702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:16:35.573010 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.574688 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.579007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1395/2843] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:35.587716 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1449/2844] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:16:35.590907 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.591186 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:35.593910 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.604664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b478af-2d51-40dd-a7e6-fec4c9f3de0e admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.610642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.619022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.619022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.619022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.619022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.619022 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.649057 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4451b82-bf71-4124-b711-690963cf88c6 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.652639 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.653279 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.653565 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.653845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.663130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.664561 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.673777 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1396/2845] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:35.735608 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1450/2846] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:16:35 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:16:35.740345 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.750580 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ea190-a8ec-43ce-a52c-af0e10c95a87 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.807348 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.808018 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.808304 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.808586 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] PATH_INFO: `/v3/users` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.809303 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.811245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.918142 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1397/2847] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:16:35 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:16:35.923303 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.935864 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0057-6dfa-4eee-b7bd-6817dd50d301 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.940923 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.941614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.941897 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.942683 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.943443 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.945028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.955274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1451/2848] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:35.959808 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:35.970283 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb202cf-43c6-4856-8074-a9667a54d77a admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:35.975548 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:35.976211 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:35.976501 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:35.976784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:35.977660 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:35.979307 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:35.991079 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1398/2849] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:16:35.995085 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:36.005462 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a724034-5a36-414c-b897-61426b0add65 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:36.010176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0641e86-b934-442b-a024-d88c861115d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:36.011091 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0641e86-b934-442b-a024-d88c861115d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:36.011375 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0641e86-b934-442b-a024-d88c861115d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:36.011654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0641e86-b934-442b-a024-d88c861115d7 admin admin] PATH_INFO: `/v3/projects/19dd9f06dfd340d88d5f76c7d8454e24/users/40e16df2feac4f41ba0cb1d0aaa696a4/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:36.027132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0641e86-b934-442b-a024-d88c861115d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19dd9f06dfd340d88d5f76c7d8454e24, user_id=40e16df2feac4f41ba0cb1d0aaa696a4, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:36.033836 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0641e86-b934-442b-a024-d88c861115d7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:36.118411 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:36.120986 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:36.133884 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1452/2850] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:16:35 2022] PUT /identity/v3/projects/19dd9f06dfd340d88d5f76c7d8454e24/users/40e16df2feac4f41ba0cb1d0aaa696a4/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:36.135092 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce22b4-11c0-42d0-b1c9-5171cc87d7f6 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:36.150443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:36.199564 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:36.199888 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:36.200132 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:36.203063 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:36.203958 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:36.204241 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:36.204520 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] PATH_INFO: `/v3/projects/ab56980ec2ec46a9ac6c1834584a7b56` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:36.205784 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab56980ec2ec46a9ac6c1834584a7b56)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:36.208023 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:36.227434 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] MFA Rules not processed for user `40e16df2feac4f41ba0cb1d0aaa696a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:36.228654 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:36.292144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1453/2851] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:16:36.303519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:36.304826 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:36.313927 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:36.362524 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0203ce7-0b2c-4b4c-99c4-ec033624b082 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:36.374994 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab56980ec2ec46a9ac6c1834584a7b56', 'request_id': 'req-ee88929a-1a19-438b-8a75-6d4695411626'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:36.381968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab56980ec2ec46a9ac6c1834584a7b56', 'request_id': 'req-ee88929a-1a19-438b-8a75-6d4695411626'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:36.388299 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab56980ec2ec46a9ac6c1834584a7b56', 'request_id': 'req-ee88929a-1a19-438b-8a75-6d4695411626'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:36.417400 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17d96b-6552-4b38-b8de-fc77127081a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:36.418057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d96b-6552-4b38-b8de-fc77127081a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:36.418340 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d96b-6552-4b38-b8de-fc77127081a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:36.418614 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d96b-6552-4b38-b8de-fc77127081a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:36.468854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] The token cache is being invalidate because project ab56980ec2ec46a9ac6c1834584a7b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:36.469151 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:36.469872 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:36.471798 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1399/2852] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:36 2022] DELETE /identity/v3/projects/ab56980ec2ec46a9ac6c1834584a7b56 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:16:36.479121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17d96b-6552-4b38-b8de-fc77127081a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:36.481274 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17d96b-6552-4b38-b8de-fc77127081a8 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:36.493999 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1454/2853] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:16:45.375398 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:45.376829 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:45.441454 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88929a-1a19-438b-8a75-6d4695411626 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:45.445928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:45.446850 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:45.447150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:45.447434 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] PATH_INFO: `/v3/users/40e16df2feac4f41ba0cb1d0aaa696a4` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:45.448636 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e16df2feac4f41ba0cb1d0aaa696a4)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:45.450564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:45.640564 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:45.643230 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e16df2feac4f41ba0cb1d0aaa696a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:45.756182 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e16df2feac4f41ba0cb1d0aaa696a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:45.763672 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e16df2feac4f41ba0cb1d0aaa696a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:45.764320 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e16df2feac4f41ba0cb1d0aaa696a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:45.764937 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e16df2feac4f41ba0cb1d0aaa696a4'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:45.783212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1400/2854] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:16:45 2022] DELETE /identity/v3/users/40e16df2feac4f41ba0cb1d0aaa696a4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:45.788482 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:45.788970 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:45.789069 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:45.806901 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:45.808202 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:45.868848 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1455/2855] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:45.878377 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:45.879816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:45.936044 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14988286-72ad-4e5d-8fab-0f0a3e8207dc admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:45.939675 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c2eec-8928-40e4-99fd-d972b8acb2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:45.940317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c2eec-8928-40e4-99fd-d972b8acb2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:45.944259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c2eec-8928-40e4-99fd-d972b8acb2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:45.944259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c2eec-8928-40e4-99fd-d972b8acb2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:45.950260 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c2eec-8928-40e4-99fd-d972b8acb2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:45.951741 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c2eec-8928-40e4-99fd-d972b8acb2d1 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:45.962145 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1401/2856] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:46.484122 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:46.487612 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:46.498382 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e983522-400e-4d2c-a485-e54e8f05b012 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:46.503760 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:46.505719 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:46.506021 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:46.506299 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] PATH_INFO: `/v3/projects/19dd9f06dfd340d88d5f76c7d8454e24` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:46.507548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19dd9f06dfd340d88d5f76c7d8454e24)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:46.510672 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:46.522643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=100 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:46.608490 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19dd9f06dfd340d88d5f76c7d8454e24', 'request_id': 'req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:46.615092 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19dd9f06dfd340d88d5f76c7d8454e24', 'request_id': 'req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:46.620625 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19dd9f06dfd340d88d5f76c7d8454e24', 'request_id': 'req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:46.709985 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] The token cache is being invalidate because project 19dd9f06dfd340d88d5f76c7d8454e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:16:46.710304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:46.711088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-51777d09-68d1-4e8c-8ca6-8c4f4a04b87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:16:46.712621 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1456/2857] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:16:46 2022] DELETE /identity/v3/projects/19dd9f06dfd340d88d5f76c7d8454e24 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:16:49.479091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:49.479630 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:49.479738 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:49.497207 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] MFA Rules not processed for user `61dbc07320584d8f8fcc71f7e745b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:16:49.498419 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:49.551379 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1402/2858] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:16:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:16:56.706775 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:59.544810 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:DELETE=4,keystone:SELECT=64,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:11.371609 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34aa2c-201f-4640-80ab-d38b115416dd None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:11.372058 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34aa2c-201f-4640-80ab-d38b115416dd None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:11.372163 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34aa2c-201f-4640-80ab-d38b115416dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:11.390401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-7d34aa2c-201f-4640-80ab-d38b115416dd None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:17:11.391624 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-7d34aa2c-201f-4640-80ab-d38b115416dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:11.446176 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1457/2859] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 22 09:17:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:17:11.601473 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:11.602928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:11.673250 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c91aa-c492-4868-8a8a-27b6de2753fb None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:11.678908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:11.679557 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:11.679845 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:11.680128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:11.688097 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:11.689693 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:11.697911 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1403/2860] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:17:21.439158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=25 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:21.694930 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=32 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:29.269398 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:29.269827 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:29.269954 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:29.288214 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] MFA Rules not processed for user `c5e68568568447c3b5324a1e10afac02`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:17:29.289401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:29.296644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1458/2861] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 22 09:17:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:17:29.308471 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:29.319045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e5cab-57f7-4b9c-8787-f322b53353f6 service swift] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:29.324035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a839b5b74e44b428f5989dd48cb1f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:29.324669 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:29.324956 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:29.325239 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:29.333779 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:29.335394 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:29.343390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1404/2862] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 22 09:17:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:17:32.275063 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:32.287201 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:32.341666 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e834-c72b-4af1-9f93-f5c759000dae None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:32.346401 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:32.347252 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:32.347542 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:32.347821 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] PATH_INFO: `/v3/users/61dbc07320584d8f8fcc71f7e745b5e7` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:32.349670 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dbc07320584d8f8fcc71f7e745b5e7)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:32.351615 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:32.509367 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dbc07320584d8f8fcc71f7e745b5e7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:32.516234 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dbc07320584d8f8fcc71f7e745b5e7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:32.516893 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dbc07320584d8f8fcc71f7e745b5e7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:32.517519 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dbc07320584d8f8fcc71f7e745b5e7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:32.530064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-c1d278fa-609c-4b0b-9b3a-386d9172079f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dbc07320584d8f8fcc71f7e745b5e7'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:32.613074 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1459/2863] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:17:32 2022] DELETE /identity/v3/users/61dbc07320584d8f8fcc71f7e745b5e7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:17:32.863647 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:32.874390 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6e452-f4e3-46b7-88e4-d8bfa442ebd4 service swift] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:32.932427 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:32.933285 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:32.933599 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:32.933879 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] PATH_INFO: `/v3/projects/0a3ef9e4d3804f5e8d1cea6c7205796e` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:32.935088 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3ef9e4d3804f5e8d1cea6c7205796e)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:32.937011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:33.062607 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'request_id': 'req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:33.069361 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'request_id': 'req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:33.074765 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3ef9e4d3804f5e8d1cea6c7205796e', 'request_id': 'req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:33.169593 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] The token cache is being invalidate because project 0a3ef9e4d3804f5e8d1cea6c7205796e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:17:33.169809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:33.170433 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-face601e-9f90-4b8b-8ed6-7bf292a3fe5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:17:33.172043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1405/2864] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:17:32 2022] DELETE /identity/v3/projects/0a3ef9e4d3804f5e8d1cea6c7205796e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:17:33.177687 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff50c5-8cd7-43e5-a79f-45309e8e815d None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.178043 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff50c5-8cd7-43e5-a79f-45309e8e815d None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.178327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff50c5-8cd7-43e5-a79f-45309e8e815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.196646 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e7ff50c5-8cd7-43e5-a79f-45309e8e815d None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:17:33.197833 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e7ff50c5-8cd7-43e5-a79f-45309e8e815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:33.254726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1460/2865] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:17:33.263148 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d80d9-7460-4c68-82a4-c9d4db3e5343 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.263504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d80d9-7460-4c68-82a4-c9d4db3e5343 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.263788 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d80d9-7460-4c68-82a4-c9d4db3e5343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.281783 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-d32d80d9-7460-4c68-82a4-c9d4db3e5343 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:17:33.283026 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-d32d80d9-7460-4c68-82a4-c9d4db3e5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:33.291406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1406/2866] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:17:33.295589 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff50c5-8cd7-43e5-a79f-45309e8e815d None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:33.305667 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff50c5-8cd7-43e5-a79f-45309e8e815d None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:33.310101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:33.310742 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.311053 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.311327 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.312049 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:17:33.312352 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:33.313942 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:33.322191 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:33.325277 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1461/2867] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 22 09:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:17:33.329360 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d80d9-7460-4c68-82a4-c9d4db3e5343 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:33.338512 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d80d9-7460-4c68-82a4-c9d4db3e5343 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:33.343175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:33.343819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.344105 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.344386 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.345114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:33.347146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:33.471100 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1407/2868] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:17:33 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:17:33.475657 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:33.486129 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc20d7-8512-417b-a0ff-c3c01e739e10 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:33.540208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:33.540867 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.541151 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.541433 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.542117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:33.544047 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:33.616913 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1462/2869] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:17:33 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:17:33.621091 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:33.631305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b4333-0967-415b-b3d2-07826179a011 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:33.635931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:33.636578 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.636861 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.637137 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.637856 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:33.639532 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:33.650313 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1408/2870] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:17:33.654150 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:33.664617 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53aaa-7f49-4ce4-b3d8-a218b7681ce7 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:33.669244 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0c47-30ea-4b7e-91d2-917488561d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:33.669889 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0c47-30ea-4b7e-91d2-917488561d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.670172 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0c47-30ea-4b7e-91d2-917488561d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.670455 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0c47-30ea-4b7e-91d2-917488561d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.671209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0c47-30ea-4b7e-91d2-917488561d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:33.678212 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0c47-30ea-4b7e-91d2-917488561d38 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:33.682508 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1463/2871] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:17:33.686406 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:33.696316 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5443-5bd5-4996-be06-2adf5f3d58af admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:33.700876 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:33.701746 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.702034 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.702317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] PATH_INFO: `/v3/projects/6ebebf95a551410b97bd5651b7173f0b/users/a9b4cf565a274509ad9871f4bbc52191/roles/3fdad772aeff41e29a0619cd969d9f72` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.717588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebebf95a551410b97bd5651b7173f0b, user_id=a9b4cf565a274509ad9871f4bbc52191, role_id=3fdad772aeff41e29a0619cd969d9f72)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:33.720305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:33.830175 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1409/2872] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:17:33 2022] PUT /identity/v3/projects/6ebebf95a551410b97bd5651b7173f0b/users/a9b4cf565a274509ad9871f4bbc52191/roles/3fdad772aeff41e29a0619cd969d9f72 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:17:33.835871 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3df93-1adf-4e0e-a45b-1eb515ed6738 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.837026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3df93-1adf-4e0e-a45b-1eb515ed6738 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.837026 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3df93-1adf-4e0e-a45b-1eb515ed6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.854308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-8ed3df93-1adf-4e0e-a45b-1eb515ed6738 None None] MFA Rules not processed for user `980b07a4628a4a1da4fc1c5439c8f483`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:17:33.855582 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-8ed3df93-1adf-4e0e-a45b-1eb515ed6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:33.912932 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1464/2873] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:17:33.922378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:33.924095 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:33.938109 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:33.979934 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9f0b-c87c-4577-baa4-570b0e9022d0 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:33.983831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:33.984467 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:33.984748 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:33.985021 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:33.994989 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:33.996410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:34.008865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1410/2874] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:17:39.026703 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe859fb-7a38-40d8-adc9-cc69b059bfec None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:39.028117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe859fb-7a38-40d8-adc9-cc69b059bfec None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:39.028117 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe859fb-7a38-40d8-adc9-cc69b059bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:39.067059 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-ffe859fb-7a38-40d8-adc9-cc69b059bfec None None] MFA Rules not processed for user `a9b4cf565a274509ad9871f4bbc52191`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:17:39.068844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-ffe859fb-7a38-40d8-adc9-cc69b059bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:39.140764 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1465/2875] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:17:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:17:39.145261 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:39.155039 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eaaa6-d83e-4669-8aed-77bda5b0cdd1 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:39.159628 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:39.160272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:39.160562 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:39.160844 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:39.161598 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:39.163757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:39.289768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1411/2876] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 22 09:17:39 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:17:39.293936 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe859fb-7a38-40d8-adc9-cc69b059bfec None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:39.305088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe859fb-7a38-40d8-adc9-cc69b059bfec None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:39.309512 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:39.363733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:39.364411 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:39.365313 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:39.365643 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] PATH_INFO: `/v3/users` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:39.366308 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:39.368289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:39.470167 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1466/2877] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 22 09:17:39 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:17:39.474650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:39.485597 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe158-c825-41dd-b654-b57528a87e9f admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:39.490757 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:39.491472 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:39.491752 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:39.492069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:39.492826 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:39.494401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:39.504992 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1412/2878] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:17:39.509314 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:39.519648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69079928-e0a3-489d-9b61-add493d1d45d admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:39.524552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:39.525458 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:39.525747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:39.526035 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] PATH_INFO: `/v3/projects/0fafa77b81ed4c54a217d4af0a901358/users/71e18509628047b8b462a95268a7ca29/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:39.543298 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fafa77b81ed4c54a217d4af0a901358, user_id=71e18509628047b8b462a95268a7ca29, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:39.545988 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:39.618769 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1467/2879] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:17:39 2022] PUT /identity/v3/projects/0fafa77b81ed4c54a217d4af0a901358/users/71e18509628047b8b462a95268a7ca29/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:17:39.620069 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:39.631558 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141281f-0cf8-4af5-9f8e-21bc0c6f1867 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:39.697818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b582e2-5ae8-48f4-abb8-a5dffae103e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:39.698504 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b582e2-5ae8-48f4-abb8-a5dffae103e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:39.698792 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b582e2-5ae8-48f4-abb8-a5dffae103e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:39.699146 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b582e2-5ae8-48f4-abb8-a5dffae103e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:39.699950 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b582e2-5ae8-48f4-abb8-a5dffae103e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:39.701547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b582e2-5ae8-48f4-abb8-a5dffae103e5 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:39.716272 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1413/2880] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 22 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:17:39.717948 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:39.732061 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8fcdd-ddab-4ea4-b2cf-aa1af377c3d1 admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:39.737101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:39.738064 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:39.738368 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:39.738627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] PATH_INFO: `/v3/projects/0fafa77b81ed4c54a217d4af0a901358/users/71e18509628047b8b462a95268a7ca29/roles/c37baaaba52a4e97b6df7fbdc86df1db` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:39.740675 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fafa77b81ed4c54a217d4af0a901358, user_id=71e18509628047b8b462a95268a7ca29, role_id=c37baaaba52a4e97b6df7fbdc86df1db)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:39.743336 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:39.755820 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1468/2881] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 22 09:17:39 2022] PUT /identity/v3/projects/0fafa77b81ed4c54a217d4af0a901358/users/71e18509628047b8b462a95268a7ca29/roles/c37baaaba52a4e97b6df7fbdc86df1db => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:17:45.246731 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8d37-19c6-4b54-8bda-0df6fc9b3100 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:45.247654 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8d37-19c6-4b54-8bda-0df6fc9b3100 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:45.248130 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f8d37-19c6-4b54-8bda-0df6fc9b3100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:45.279011 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-534f8d37-19c6-4b54-8bda-0df6fc9b3100 None None] MFA Rules not processed for user `71e18509628047b8b462a95268a7ca29`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:17:45.280280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-534f8d37-19c6-4b54-8bda-0df6fc9b3100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:45.370791 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1414/2882] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:17:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:17:45.388220 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:45.389968 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:45.472410 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c360-4cc3-41e8-a390-6e72d1079ceb admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:45.478653 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:45.479355 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:45.479645 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:45.480178 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:45.538691 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:45.540311 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:45.544152 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:45.549976 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1469/2883] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:17:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:17:55.367717 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:55.619225 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:03.569857 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca06d18-6a89-4515-8d3e-267063872016 None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:03.570350 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca06d18-6a89-4515-8d3e-267063872016 None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:03.570457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca06d18-6a89-4515-8d3e-267063872016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:03.587381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-5ca06d18-6a89-4515-8d3e-267063872016 None None] MFA Rules not processed for user `a9b4cf565a274509ad9871f4bbc52191`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:18:03.588556 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-5ca06d18-6a89-4515-8d3e-267063872016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:03.595305 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1415/2884] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:18:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:18:03.632369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:03.633776 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:03.688724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a795c1-a8e0-40c6-8cd6-1f22c468508d service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:03.692289 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497a2c9e3fe04d9e85d513c9beb4f6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:03.692952 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:03.693236 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:03.693513 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:03.695264 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:03.708209 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:03.710121 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:03.720950 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1470/2885] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:03.994723 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca06d18-6a89-4515-8d3e-267063872016 None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:04.048443 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca06d18-6a89-4515-8d3e-267063872016 None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:04.051968 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:04.053150 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:04.053436 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:04.053715 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:04.055497 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:04.064768 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:04.066181 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:04.074128 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1416/2886] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:04.809206 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:04.810664 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:04.814931 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:04.816588 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:04.828410 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f91d2-31c4-42a4-b657-15ee9af38966 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:04.834852 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:04.835543 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:04.836083 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:04.836373 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:04.838180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:04.854031 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:04.855522 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:04.867629 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1417/2887] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:18:04.882028 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c8ef-6c4b-4795-8df0-beee1cf12a70 service cinder] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:04.887057 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:04.887705 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:04.887992 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:04.888273 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:04.890155 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:04.902663 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:04.904351 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:04.914601 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1471/2888] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:08.002342 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:08.011602 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca9502-26da-4178-8c78-30f05354b62f service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:08.015275 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:08.015916 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:08.016212 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:08.016491 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:08.018259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:08.028043 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:08.029470 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:08.038928 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1418/2889] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:08.821875 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:08.836849 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678e67-417d-4449-8012-43ea3851c6cd service placement] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:08.842648 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:08.843343 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:08.843632 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:08.843914 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:08.845845 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:08.859412 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:08.861009 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:08.874286 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1472/2890] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:18.033917 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=41 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:18.869285 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=64 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:20.334219 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:20.339977 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:20.351988 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0712-6510-4d41-8ee3-c715eaaf4c85 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:20.357866 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:20.358515 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:20.358809 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:20.359121 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:20.360918 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:20.373800 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:20.375399 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:20.386560 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1419/2891] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:22.465634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:22.474726 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6475b1-68b4-4f60-bc87-1b2364c96cd6 service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:22.479015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2d21-ba8f-412f-946a-4bf9673bedbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:22.479642 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2d21-ba8f-412f-946a-4bf9673bedbf service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:22.479922 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2d21-ba8f-412f-946a-4bf9673bedbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:22.480197 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2d21-ba8f-412f-946a-4bf9673bedbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:22.489165 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c2d21-ba8f-412f-946a-4bf9673bedbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:22.490579 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c2d21-ba8f-412f-946a-4bf9673bedbf service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:22.499737 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1473/2892] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:30.381429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=6 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:32.495724 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=6 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:21.604352 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:20:21.667579 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de629994-a386-49a6-a8e9-5969d01b1723 service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:20:21.673245 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9c09-c09a-4222-8e38-68a549c75c54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:20:21.673897 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9c09-c09a-4222-8e38-68a549c75c54 service placement] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:21.674180 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9c09-c09a-4222-8e38-68a549c75c54 service placement] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:21.674457 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9c09-c09a-4222-8e38-68a549c75c54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:21.676392 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-205e9c09-c09a-4222-8e38-68a549c75c54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:21.709201 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e9c09-c09a-4222-8e38-68a549c75c54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:20:21.710758 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e9c09-c09a-4222-8e38-68a549c75c54 service placement] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:20:21.720567 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1420/2893] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:20:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:20:24.678844 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618a02-538b-487e-a82f-9f3a425f70e5 None None] REQUEST_METHOD: `POST` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:20:24.679973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618a02-538b-487e-a82f-9f3a425f70e5 None None] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:20:24.679973 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618a02-538b-487e-a82f-9f3a425f70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:20:24.697144 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.auth.core [None req-e5618a02-538b-487e-a82f-9f3a425f70e5 None None] MFA Rules not processed for user `a9b4cf565a274509ad9871f4bbc52191`. Rule list: `[]` (Enabled: `True`). {{(pid=80550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:20:24.698346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-e5618a02-538b-487e-a82f-9f3a425f70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:20:24.705094 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1474/2894] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:20:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:20:31.716317 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=36 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:20:34.691383 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=3 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:30.281335 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd423f5-cca7-435c-aefe-7ec1b3da2a4d None None] REQUEST_METHOD: `POST` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:30.281881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd423f5-cca7-435c-aefe-7ec1b3da2a4d None None] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:30.281881 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd423f5-cca7-435c-aefe-7ec1b3da2a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:30.301176 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.auth.core [None req-ffd423f5-cca7-435c-aefe-7ec1b3da2a4d None None] MFA Rules not processed for user `a9b4cf565a274509ad9871f4bbc52191`. Rule list: `[]` (Enabled: `True`). {{(pid=80551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:22:30.302422 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-ffd423f5-cca7-435c-aefe-7ec1b3da2a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:30.310015 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1421/2895] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 22 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:22:30.631958 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618a02-538b-487e-a82f-9f3a425f70e5 None None] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:30.651696 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618a02-538b-487e-a82f-9f3a425f70e5 None None] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:30.655268 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:30.655901 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:30.656189 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:30.656469 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:30.658207 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:22:30.679929 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:30.681347 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:30.689275 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1475/2896] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:40.296384 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=3 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:40.685693 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=15 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:22:45.526114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd423f5-cca7-435c-aefe-7ec1b3da2a4d None None] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:22:45.555754 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd423f5-cca7-435c-aefe-7ec1b3da2a4d None None] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:22:45.561177 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:22:45.561818 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:22:45.562101 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:22:45.562378 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:22:45.570862 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:22:45.572432 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:22:45.581790 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1422/2897] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:22:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:22:55.577152 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=13 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:23:23.702448 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:23:23.711088 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41efc33-3686-4dfa-a367-f68f383591d5 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:23:23.714627 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:23:23.715332 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:23:23.715623 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:23:23.715892 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:23:23.723015 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:23:23.724418 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:23:23.733335 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1476/2898] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:23:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:23:33.728839 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=6 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:30.250650 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:30.264864 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7550b-9762-4a85-8fe3-68f8c9a5e759 service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:30.270550 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:30.271238 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:30.271523 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:30.271804 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:30.282700 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:30.284295 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:30.296610 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1423/2899] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:30.601602 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:30.612208 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d0795-74a1-46df-a840-ae509aba4980 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:30.616974 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:30.617634 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:30.618457 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:30.618702 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:30.629939 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:30.631436 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:30.643997 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1477/2900] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:31.831865 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:31.841347 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02747e-83da-42ab-9928-29353086b6dc service nova] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:31.845041 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:31.845684 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:31.845975 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:31.846259 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:31.857566 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:31.859054 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:31.870763 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1424/2901] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:38.898861 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:38.911107 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73454f-10dd-4e70-8165-41996ccd3522 service neutron] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:38.918305 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0cbf8022ee4c37a591ee578b53806c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:38.924029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:38.924029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:38.924029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:38.924029 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:38.949733 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:38.951552 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:38.963438 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1478/2902] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:41.865126 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=12 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:46.207966 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:46.217429 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e06ab-5a27-4fda-99e1-b818bd99d549 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:46.221114 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6bbb0e4d7ca44fc8cb68fdc96260caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:46.221750 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:46.222035 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:46.222315 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:46.290478 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:46.291970 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:46.310908 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1425/2903] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:24:48.959131 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=17 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:49.962112 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:49.973530 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0974a-5215-4dbd-89e6-934b33d2e0e2 service nova] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:49.978603 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:49.980154 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] REQUEST_METHOD: `GET` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:49.980759 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:49.981101 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:49.983031 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:49.995515 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:49.997185 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:50.007334 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1479/2904] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:24:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:24:53.612381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:53.623292 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72d5e-a125-40ce-bfa1-22e47af2f969 service neutron] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:53.627819 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:53.628692 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:53.628973 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:53.629247 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] PATH_INFO: `/v3/users/a9b4cf565a274509ad9871f4bbc52191` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:53.630425 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b4cf565a274509ad9871f4bbc52191)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:53.632381 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:53.895246 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b4cf565a274509ad9871f4bbc52191'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:53.971980 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b4cf565a274509ad9871f4bbc52191'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:53.979444 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b4cf565a274509ad9871f4bbc52191'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:53.980925 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b4cf565a274509ad9871f4bbc52191'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:53.981547 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b4cf565a274509ad9871f4bbc52191'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:53.998816 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1426/2905] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:24:53 2022] DELETE /identity/v3/users/a9b4cf565a274509ad9871f4bbc52191 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:24:54.259678 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:54.272270 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96795-6400-46e8-8c57-c28a78ede585 service placement] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:54.332993 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:54.333851 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:54.334139 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:54.334425 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] PATH_INFO: `/v3/projects/6ebebf95a551410b97bd5651b7173f0b` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:54.335644 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebebf95a551410b97bd5651b7173f0b)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:54.337548 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:54.491346 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebebf95a551410b97bd5651b7173f0b', 'request_id': 'req-535c1bbb-f302-4713-9e11-b7f4fa607b9c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.497369 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebebf95a551410b97bd5651b7173f0b', 'request_id': 'req-535c1bbb-f302-4713-9e11-b7f4fa607b9c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.502777 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebebf95a551410b97bd5651b7173f0b', 'request_id': 'req-535c1bbb-f302-4713-9e11-b7f4fa607b9c'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.594747 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] The token cache is being invalidate because project 6ebebf95a551410b97bd5651b7173f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:24:54.595078 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.595707 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.597235 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1480/2906] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:24:54 2022] DELETE /identity/v3/projects/6ebebf95a551410b97bd5651b7173f0b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:54.601401 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:54.602831 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:54.616461 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d69e-16bb-40e8-b1d9-05f11fa5e153 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:54.661179 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:54.672525 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:54.673413 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:54.673721 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:54.674007 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] PATH_INFO: `/v3/users/71e18509628047b8b462a95268a7ca29` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:54.675227 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e18509628047b8b462a95268a7ca29)` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:54.678164 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:54.831883 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e18509628047b8b462a95268a7ca29'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.926362 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e18509628047b8b462a95268a7ca29'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.934106 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e18509628047b8b462a95268a7ca29'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.934736 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e18509628047b8b462a95268a7ca29'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.937820 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.notifications [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e18509628047b8b462a95268a7ca29'} {{(pid=80551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:54.952107 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1427/2907] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 22 09:24:54 2022] DELETE /identity/v3/users/71e18509628047b8b462a95268a7ca29 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:24:55.217200 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Authenticating user token {{(pid=80550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:24:55.219177 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.fernet_utils [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:24:55.236160 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1bbb-f302-4713-9e11-b7f4fa607b9c admin admin] Validating token access rules against request {{(pid=80550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:24:55.293463 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980b07a4628a4a1da4fc1c5439c8f483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220b7f5f59544863b1dda75a37a7b01f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:24:55.294319 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:24:55.294650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:24:55.294966 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] PATH_INFO: `/v3/projects/0fafa77b81ed4c54a217d4af0a901358` {{(pid=80550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:24:55.296158 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fafa77b81ed4c54a217d4af0a901358)` {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:24:55.298083 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] RBAC: Authorization granted {{(pid=80550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:24:55.305870 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:24:55.482020 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fafa77b81ed4c54a217d4af0a901358', 'request_id': 'req-8053d181-b318-426f-b71b-478d80bd8b05'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:55.489618 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fafa77b81ed4c54a217d4af0a901358', 'request_id': 'req-8053d181-b318-426f-b71b-478d80bd8b05'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:55.495239 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fafa77b81ed4c54a217d4af0a901358', 'request_id': 'req-8053d181-b318-426f-b71b-478d80bd8b05'} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:55.669119 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] The token cache is being invalidate because project 0fafa77b81ed4c54a217d4af0a901358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:24:55.669322 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:55.669949 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG keystone.notifications [None req-8053d181-b318-426f-b71b-478d80bd8b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:24:55.671650 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: [pid: 80550|app: 0|req: 1481/2908] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 22 09:24:55 2022] DELETE /identity/v3/projects/0fafa77b81ed4c54a217d4af0a901358 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:25:05.029585 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:05.665304 dv-cinder-803823-12-iscsi devstack@keystone.service[80550]: DEBUG dbcounter [-] [80550] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:25:25.228280 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Authenticating user token {{(pid=80551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:25:25.229854 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:25.299583 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649278c1-f2db-43e0-9b3d-119338f86489 admin admin] Validating token access rules against request {{(pid=80551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:25:25.360220 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d624242-e906-4f41-9323-8f7b7c8f42f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd20d4b992c84434ba0ab81046009e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b71bcfec571b4cc1862be949aa761fcb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:25:25.360620 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624242-e906-4f41-9323-8f7b7c8f42f7 service placement] REQUEST_METHOD: `GET` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:25:25.360903 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624242-e906-4f41-9323-8f7b7c8f42f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:25:25.361203 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624242-e906-4f41-9323-8f7b7c8f42f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:25:25.363045 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.fernet_utils [None req-7d624242-e906-4f41-9323-8f7b7c8f42f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:25:25.374396 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d624242-e906-4f41-9323-8f7b7c8f42f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:25:25.375997 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d624242-e906-4f41-9323-8f7b7c8f42f7 service placement] RBAC: Authorization granted {{(pid=80551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:25:25.385787 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: [pid: 80551|app: 0|req: 1428/2909] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 22 09:25:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:25:35.381542 dv-cinder-803823-12-iscsi devstack@keystone.service[80551]: DEBUG dbcounter [-] [80551] Writing DB stats keystone:SELECT=58 {{(pid=80551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}